Jun 09 11:44:12.083531 np0000002435 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jun 09 11:44:13.617715 np0000002435 nova-compute[98325]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98325) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 09 11:44:13.618483 np0000002435 nova-compute[98325]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98325) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 09 11:44:13.618483 np0000002435 nova-compute[98325]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jun 09 11:44:13.740902 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:44:13.751007 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:44:13.798448 np0000002435 nova-compute[98325]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jun 09 11:44:14.527252 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jun 09 11:44:14.527406 np0000002435 nova-compute[98325]: INFO nova.utils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] The long task thread pool MainProcess.long_task is initialized Jun 09 11:44:14.527663 np0000002435 nova-compute[98325]: INFO nova.virt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Loading compute driver 'libvirt.LibvirtDriver' Jun 09 11:44:14.721886 np0000002435 nova-compute[98325]: INFO nova.compute.provider_config [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jun 09 11:44:15.224502 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Acquiring lock "singleton_lock" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:44:15.224634 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Acquired lock "singleton_lock" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:44:15.224880 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Releasing lock "singleton_lock" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:44:15.225050 np0000002435 nova-compute[98325]: WARNING oslo_service.backend._threading.service [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] no_fork=True: running service in main process Jun 09 11:44:15.225331 np0000002435 nova-compute[98325]: INFO nova.service [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Starting compute node (version 33.1.0) Jun 09 11:44:15.730759 np0000002435 nova-compute[98325]: INFO nova.utils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] The default thread pool MainProcess.default is initialized Jun 09 11:44:15.731400 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:44:15.731642 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Starting event thread {{(pid=98325) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jun 09 11:44:15.732051 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Starting connection event dispatch thread {{(pid=98325) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jun 09 11:44:15.732757 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Connecting to libvirt: qemu:///system {{(pid=98325) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jun 09 11:44:16.390371 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Registering for lifecycle events {{(pid=98325) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jun 09 11:44:16.391890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Registering for connection events: {{(pid=98325) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jun 09 11:44:16.392246 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Connection event '1' reason 'None' Jun 09 11:44:16.895067 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Cannot update service status on host "np0000002435" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000002435 could not be found. Jun 09 11:44:16.895067 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.mount [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Initialising _HostMountState generation 0 {{(pid=98325) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host capabilities Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: e001dbb5-8e31-4d2d-9429-583c49bd28ff Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: x86_64 Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: tcp Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: rdma Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.641653 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: 24607192 Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: 6151798 Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: 0 Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: 0 Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.643632 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: apparmor Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: 0 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: dac Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: 0 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: +64055:+993 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: +64055:+993 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-alpha Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: clipper Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-arm Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: qcom-dc-scm-v1-bmc Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: mori-bmc Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: ast2600-evb Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: borzoi Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: tiogapass-bmc Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: spitz Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: virt-2.7 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: nuri Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: mcimx7d-sabre Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: romulus-bmc Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: virt-3.0 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: virt-5.0 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: npcm750-evb Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: virt-2.10 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: rainier-bmc Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: mps3-an547 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: musca-b1 Jun 09 11:44:26.644603 np0000002435 nova-compute[98325]: realview-pbx-a9 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: versatileab Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: kzm Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-2.8 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: fby35-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: musca-a Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-3.1 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: mcimx6ul-evk Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-5.1 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: smdkc210 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: sx1 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-2.11 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: imx25-pdk Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: stm32vldiscovery Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-2.9 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: orangepi-pc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: quanta-q71l-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: z2 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-5.2 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: xilinx-zynq-a9 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: tosa Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: mps2-an500 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-2.12 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: mps2-an521 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: sabrelite Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: mps2-an511 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: canon-a1100 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: realview-eb Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: quanta-gbs-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: emcraft-sf2 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: realview-pb-a8 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: yosemitev2-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-7.0 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-4.0 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: raspi1ap Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: palmetto-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: sx1-v1 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: n810 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: g220a-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: n800 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: bletchley-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-7.1 Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: tacoma-bmc Jun 09 11:44:26.650990 np0000002435 nova-compute[98325]: virt-4.1 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: quanta-gsj Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: versatilepb Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: terrier Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: mainstone Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: realview-eb-mpcore Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: integratorcp Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-7.2 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: supermicrox11-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-4.2 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: witherspoon-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: qcom-firework-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: mps3-an524 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: kudo-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: vexpress-a9 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: midway Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: musicpal Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: lm3s811evb Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: lm3s6965evb Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: supermicro-x11spi-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: microbit Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: fby35 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: mps2-an505 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: mps2-an385 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-6.0 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-8.0 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: cubieboard Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: ast1030-evb Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: verdex Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: bpim2u Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: netduino2 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: mps2-an386 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: olimex-stm32-h405 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-6.1 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-8.1 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: raspi2b Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: vexpress-a15 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: fuji-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-6.2 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: sonorapass-bmc Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: cheetah Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: virt-2.6 Jun 09 11:44:26.655710 np0000002435 nova-compute[98325]: ast2500-evb Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: highbank Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: akita Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: connex Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: netduinoplus2 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: collie Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: raspi0 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: fp5280g2-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-arm Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: qcom-dc-scm-v1-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: mori-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: ast2600-evb Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: borzoi Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: tiogapass-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: spitz Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-2.7 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: nuri Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: mcimx7d-sabre Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: romulus-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-3.0 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-5.0 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: npcm750-evb Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-2.10 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: rainier-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: mps3-an547 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: musca-b1 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: realview-pbx-a9 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: versatileab Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: kzm Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-2.8 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: fby35-bmc Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: musca-a Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-3.1 Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: mcimx6ul-evk Jun 09 11:44:26.657325 np0000002435 nova-compute[98325]: virt-5.1 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: smdkc210 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: sx1 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-2.11 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: imx25-pdk Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: stm32vldiscovery Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-2.9 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: orangepi-pc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: quanta-q71l-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: z2 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-5.2 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: xilinx-zynq-a9 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: tosa Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: mps2-an500 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-2.12 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: mps2-an521 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: sabrelite Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: mps2-an511 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: canon-a1100 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: realview-eb Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: quanta-gbs-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: emcraft-sf2 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: realview-pb-a8 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: yosemitev2-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-7.0 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-4.0 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: raspi1ap Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: palmetto-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: sx1-v1 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: n810 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: g220a-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: n800 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: bletchley-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-7.1 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: tacoma-bmc Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-4.1 Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: quanta-gsj Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: versatilepb Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: terrier Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: mainstone Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: realview-eb-mpcore Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: integratorcp Jun 09 11:44:26.658469 np0000002435 nova-compute[98325]: virt-7.2 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: supermicrox11-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-4.2 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: witherspoon-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: qcom-firework-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: mps3-an524 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: kudo-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: vexpress-a9 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: midway Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: musicpal Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: lm3s811evb Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: lm3s6965evb Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: supermicro-x11spi-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: microbit Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: fby35 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: mps2-an505 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: mps2-an385 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-6.0 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-8.0 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: cubieboard Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: ast1030-evb Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: verdex Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: bpim2u Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: netduino2 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: mps2-an386 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: olimex-stm32-h405 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-6.1 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-8.1 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: raspi2b Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: vexpress-a15 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: fuji-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-6.2 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: sonorapass-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: cheetah Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: virt-2.6 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: ast2500-evb Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: highbank Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: akita Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: connex Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: netduinoplus2 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: collie Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: raspi0 Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: fp5280g2-bmc Jun 09 11:44:26.668304 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-aarch64 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: qcom-dc-scm-v1-bmc Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: mori-bmc Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: ast2600-evb Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: borzoi Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: tiogapass-bmc Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: spitz Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-2.7 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: nuri Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: mcimx7d-sabre Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: romulus-bmc Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-3.0 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-5.0 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: npcm750-evb Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-2.10 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: rainier-bmc Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: mps3-an547 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-2.8 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: musca-b1 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: realview-pbx-a9 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: versatileab Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: kzm Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: fby35-bmc Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: musca-a Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-3.1 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: mcimx6ul-evk Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-5.1 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: smdkc210 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: sx1 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-2.11 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: imx25-pdk Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: stm32vldiscovery Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: virt-2.9 Jun 09 11:44:26.669419 np0000002435 nova-compute[98325]: orangepi-pc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: quanta-q71l-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: z2 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-5.2 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: xilinx-zynq-a9 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: xlnx-zcu102 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: tosa Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: mps2-an500 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-2.12 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: mps2-an521 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: sabrelite Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: mps2-an511 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: canon-a1100 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: realview-eb Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: quanta-gbs-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: emcraft-sf2 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: realview-pb-a8 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: sbsa-ref Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: yosemitev2-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-7.0 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-4.0 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: raspi1ap Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: palmetto-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: sx1-v1 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: n810 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: g220a-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: n800 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: bletchley-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-7.1 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: tacoma-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-4.1 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: quanta-gsj Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: versatilepb Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: terrier Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: mainstone Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: realview-eb-mpcore Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: integratorcp Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-7.2 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: supermicrox11-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: virt-4.2 Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: witherspoon-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: qcom-firework-bmc Jun 09 11:44:26.670470 np0000002435 nova-compute[98325]: mps3-an524 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: kudo-bmc Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: vexpress-a9 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: midway Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: musicpal Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: lm3s811evb Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: lm3s6965evb Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: supermicro-x11spi-bmc Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: microbit Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: fby35 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: mps2-an505 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: mps2-an385 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: virt-6.0 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: virt-8.0 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: raspi3ap Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: cubieboard Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: ast1030-evb Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: verdex Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: bpim2u Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: netduino2 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: xlnx-versal-virt Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: mps2-an386 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: olimex-stm32-h405 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: virt-6.1 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: virt-8.1 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: raspi3b Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: raspi2b Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: vexpress-a15 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: fuji-bmc Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: virt-6.2 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: sonorapass-bmc Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: cheetah Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: virt-2.6 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: ast2500-evb Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: highbank Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: akita Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: connex Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: netduinoplus2 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: collie Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: raspi0 Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: fp5280g2-bmc Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: Jun 09 11:44:26.671249 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-cris Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: axis-dev88 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-i386 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-noble-v2 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: ubuntu Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-mantic Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-impish-hpb Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-5.2 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-lunar-hpb Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-mantic Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-2.12 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-2.0 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-xenial Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-kinetic Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-6.2 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-4.2 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-mantic-maxcpus Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-2.5 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-4.2 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-focal Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-hirsute Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-xenial Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-jammy-hpb Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-5.2 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-2.7 Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-eoan-hpb Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-i440fx-disco-hpb Jun 09 11:44:26.673556 np0000002435 nova-compute[98325]: pc-q35-groovy Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-zesty Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-lunar Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-mantic-hpb-maxcpus Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-groovy Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-7.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-artful Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-trusty Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-2.2 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-eoan-hpb Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-focal-hpb Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-8.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-jammy-maxcpus Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-bionic-hpb Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-mantic-hpb Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-artful Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-8.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-2.7 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-6.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-kinetic Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-jammy-maxcpus Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-yakkety Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-2.4 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-cosmic-hpb Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-7.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-2.10 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: x-remote Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-5.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-2.9 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-2.11 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-jammy-hpb-maxcpus Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-3.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-6.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-4.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-jammy Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-2.4 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-i440fx-4.1 Jun 09 11:44:26.674906 np0000002435 nova-compute[98325]: pc-q35-eoan Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-jammy-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-5.1 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-2.9 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-bionic-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-lunar Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: isapc Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-mantic-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-cosmic Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-2.6 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-mantic-maxcpus Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-3.1 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-bionic Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-disco-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-cosmic Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-2.12 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-bionic Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-kinetic-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-groovy-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-7.0 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-noble-v2 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: ubuntu-q35 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-lunar-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-disco Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-cosmic-hpb Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-noble Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: q35 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-2.1 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-8.0 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-impish Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-wily Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-8.0 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-2.6 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-6.0 Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-impish Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-i440fx-jammy Jun 09 11:44:26.677487 np0000002435 nova-compute[98325]: pc-q35-impish-hpb Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-hirsute Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-4.0.1 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-hirsute-hpb Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-7.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-5.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-2.8 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-2.10 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-3.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-6.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-zesty Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-7.2 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-4.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-focal Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: microvm Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-2.3 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-jammy-hpb-maxcpus Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-8.2 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: q35 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-kinetic-hpb Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-focal-hpb Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-4.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-noble Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-disco Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-groovy-hpb Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-8.2 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-hirsute-hpb Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-5.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-6.2 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-2.8 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-eoan Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-2.5 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-3.0 Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-q35-yakkety Jun 09 11:44:26.678644 np0000002435 nova-compute[98325]: pc-i440fx-mantic-hpb-maxcpus Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: pc-i440fx-7.2 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: pc-q35-2.11 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-m68k Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: mcf5208evb Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-7.0 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: an5206 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-6.0 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: q800 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-8.1 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-7.2 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-6.2 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-8.0 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: next-cube Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-7.1 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-6.1 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-microblaze Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: petalogix-s3adsp1800 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: petalogix-ml605 Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: xlnx-zynqmp-pmu Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: Jun 09 11:44:26.679601 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-microblazeel Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: petalogix-s3adsp1800 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: petalogix-ml605 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: xlnx-zynqmp-pmu Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mips Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: mipssim Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mipsel Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: mipssim Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mips64 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: mipssim Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: pica61 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: magnum Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mips64el Jun 09 11:44:26.681226 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: loongson3-virt Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: mipssim Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pica61 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: magnum Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: boston Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: fuloong2e Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: g3beige Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: amigaone Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: virtex-ml507 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: mac99 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: ppce500 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: sam460ex Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pegasos2 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: bamboo Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: 40p Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: ref405ep Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: mpc8544ds Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pseries-noble Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pseries Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: amigaone Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: powernv9 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: powernv Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pseries-4.1 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: mpc8544ds Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pseries-6.1 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: pseries-2.5 Jun 09 11:44:26.682785 np0000002435 nova-compute[98325]: powernv10 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-xenial Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-4.2 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-6.2 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-yakkety Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.6 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: ppce500 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-bionic-sxxm Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.7 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-3.0 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-8.0 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-5.0 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: 40p Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-lunar Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.8 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pegasos2 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-hirsute Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-3.1 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-8.1 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-5.1 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-eoan Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.9 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-zesty Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: bamboo Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-groovy Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-focal Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: g3beige Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-8.2 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-5.2 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-disco Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.12-sxxm Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-mantic Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-kinetic Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.10 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-7.0 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: virtex-ml507 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.11 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-2.1 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-7.1 Jun 09 11:44:26.684584 np0000002435 nova-compute[98325]: pseries-cosmic Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-bionic Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-2.12 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-2.2 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-7.2 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: mac99 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-impish Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-jammy Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-artful Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: sam460ex Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: ref405ep Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-2.3 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: powernv8 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-4.0 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-6.0 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-2.4 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64le Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-noble Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: amigaone Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: powernv9 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: powernv Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-4.1 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: mpc8544ds Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-6.1 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-2.5 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: powernv10 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-xenial Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-4.2 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-6.2 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-yakkety Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-2.6 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: ppce500 Jun 09 11:44:26.685667 np0000002435 nova-compute[98325]: pseries-bionic-sxxm Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.7 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-3.0 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-8.0 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-5.0 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: 40p Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-lunar Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.8 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pegasos2 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-hirsute Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-3.1 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-8.1 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-5.1 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-eoan Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.9 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-zesty Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: bamboo Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-groovy Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-focal Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: g3beige Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-8.2 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-5.2 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-disco Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.12-sxxm Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-mantic Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-kinetic Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.10 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-7.0 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: virtex-ml507 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.11 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.1 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-7.1 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-cosmic Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-bionic Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.12 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-2.2 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-7.2 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: mac99 Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-impish Jun 09 11:44:26.686539 np0000002435 nova-compute[98325]: pseries-jammy Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: pseries-artful Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: sam460ex Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: ref405ep Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: pseries-2.3 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: powernv8 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: pseries-4.0 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: pseries-6.0 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: pseries-2.4 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-riscv32 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: spike Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: opentitan Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: sifive_u Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: sifive_e Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-riscv64 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: spike Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: microchip-icicle-kit Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: sifive_u Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: shakti_c Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: sifive_e Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-s390x Jun 09 11:44:26.687184 np0000002435 nova-compute[98325]: s390-ccw-virtio-noble Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-8.0 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-disco Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-6.0 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.11 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-7.0 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-mantic Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-xenial Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-5.0 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-focal Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.8 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-4.0 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-zesty Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-8.2 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-6.2 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-3.0 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-groovy Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.5 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-7.2 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-5.2 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-artful Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-hirsute Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-4.2 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.10 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.7 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-lunar Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-eoan Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-kinetic Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-8.1 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-yakkety Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-6.1 Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-cosmic Jun 09 11:44:26.689833 np0000002435 nova-compute[98325]: s390-ccw-virtio-bionic Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.12 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-7.1 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.4 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-5.1 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.9 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-impish Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-4.1 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-jammy Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-3.1 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: s390-ccw-virtio-2.6 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sh4 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: shix Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: r2d Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sh4eb Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: shix Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: r2d Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sparc Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: SS-5 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: SS-20 Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: LX Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: SPARCClassic Jun 09 11:44:26.690952 np0000002435 nova-compute[98325]: leon3_generic Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: SPARCbook Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: SS-4 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: SS-600MP Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: SS-10 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Voyager Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sparc64 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: sun4u Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: niagara Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: sun4v Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: 64 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-x86_64 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-noble-v2 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: ubuntu Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-q35-mantic Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-impish-hpb Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-q35-5.2 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-q35-lunar-hpb Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-mantic Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-2.12 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-2.0 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-xenial Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-q35-kinetic Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-6.2 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-q35-4.2 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-mantic-maxcpus Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-2.5 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-4.2 Jun 09 11:44:26.692170 np0000002435 nova-compute[98325]: pc-i440fx-focal Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-hirsute Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-xenial Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-jammy-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-5.2 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-2.7 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-eoan-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-zesty Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-groovy Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-disco-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-lunar Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-mantic-hpb-maxcpus Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-groovy Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-7.1 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-artful Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-trusty Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-2.2 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-focal-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-8.1 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-eoan-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-jammy-maxcpus Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-bionic-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-mantic-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-artful Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-8.1 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-2.7 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-6.1 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-kinetic Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-jammy-maxcpus Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-yakkety Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-2.4 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-cosmic-hpb Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-7.1 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-2.10 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: x-remote Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-5.1 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-q35-2.9 Jun 09 11:44:26.693127 np0000002435 nova-compute[98325]: pc-i440fx-2.11 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-jammy-hpb-maxcpus Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-3.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-6.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-4.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-jammy Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-2.4 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-4.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-eoan Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-jammy-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-5.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-2.9 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-bionic-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-lunar Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: isapc Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-mantic-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-cosmic Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-2.6 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-mantic-maxcpus Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-3.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-bionic Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-disco-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-cosmic Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-2.12 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-bionic Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-kinetic-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-groovy-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-7.0 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-noble-v2 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: ubuntu-q35 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-lunar-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-disco Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-cosmic-hpb Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-i440fx-2.1 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-noble Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: q35 Jun 09 11:44:26.693700 np0000002435 nova-compute[98325]: pc-q35-8.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-wily Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-impish Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-8.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-2.6 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-6.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-impish Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-jammy Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-impish-hpb Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-hirsute Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-4.0.1 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-hirsute-hpb Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-7.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-5.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-2.8 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-2.10 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-3.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-zesty Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-7.2 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-4.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-6.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-focal Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: microvm Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-2.3 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-jammy-hpb-maxcpus Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-disco Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-kinetic-hpb Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-4.0 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-focal-hpb Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-noble Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-q35-8.2 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: q35 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-groovy-hpb Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-hirsute-hpb Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc-i440fx-8.2 Jun 09 11:44:26.694249 np0000002435 nova-compute[98325]: pc Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-i440fx-5.0 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-i440fx-2.8 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-q35-6.2 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-i440fx-eoan Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-q35-2.5 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-i440fx-3.0 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-q35-yakkety Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-i440fx-mantic-hpb-maxcpus Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-i440fx-7.2 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: pc-q35-2.11 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-xtensa Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: sim Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: kc705 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: ml605 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: ml605-nommu Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: lx60-nommu Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: lx200 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: lx200-nommu Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: lx60 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: kc705-nommu Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: hvm Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: 32 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-xtensaeb Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: sim Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: kc705 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: ml605 Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: ml605-nommu Jun 09 11:44:26.694796 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: lx60-nommu Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: lx200 Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: lx200-nommu Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: lx60 Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: kc705-nommu Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-alpha Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: clipper Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: alpha Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: Jun 09 11:44:26.695612 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.698480 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-arm Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: armv6l Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.699915 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270-c0 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-a15 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270-b0 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-m4 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270-a0 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: arm1176 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270-b1 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-a7 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270-a1 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-a8 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-r5 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: ti925t Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-r5f Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: arm1026 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-a9 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-m7 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa260 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa250 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa270-c5 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa261 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: pxa262 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: sa1110 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-r52 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: sa1100 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: max Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-m0 Jun 09 11:44:26.701065 np0000002435 nova-compute[98325]: cortex-m33 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: arm946 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: pxa255 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: arm11mpcore Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: cortex-m55 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: arm926 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: arm1136 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: arm1136-r2 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: cortex-m3 Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.701749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: 2 Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: 3 Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.704716 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-arm Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: armv6l Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: pxa270-c0 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: cortex-a15 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: pxa270-b0 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: cortex-m4 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: pxa270-a0 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: arm1176 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: pxa270-b1 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: cortex-a7 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: pxa270-a1 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: cortex-a8 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: cortex-r5 Jun 09 11:44:26.707176 np0000002435 nova-compute[98325]: ti925t Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-r5f Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: arm1026 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-a9 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-m7 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa270 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa260 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa250 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa270-c5 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa261 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa262 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: sa1110 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-r52 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: sa1100 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: max Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-m0 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-m33 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: arm946 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: pxa255 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: arm11mpcore Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-m55 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: arm926 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: arm1136 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: arm1136-r2 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cortex-m3 Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.708244 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: Jun 09 11:44:26.709751 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: 2 Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: 3 Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-arm Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: armv7l Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: efi Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.711118 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270-c0 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-a15 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270-b0 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-m4 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270-a0 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: arm1176 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270-b1 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-a7 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270-a1 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-a8 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-r5 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: ti925t Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-r5f Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: arm1026 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-a9 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-m7 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa260 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa250 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa270-c5 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa261 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: pxa262 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: sa1110 Jun 09 11:44:26.713631 np0000002435 nova-compute[98325]: cortex-r52 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: sa1100 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: max Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: cortex-m0 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: cortex-m33 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: arm946 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: pxa255 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: arm11mpcore Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: cortex-m55 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: arm926 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: arm1136 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: arm1136-r2 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: cortex-m3 Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.714503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: 2 Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: 3 Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.715532 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-aarch64 Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: aarch64 Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: efi Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: neoverse-n2 Jun 09 11:44:26.717257 np0000002435 nova-compute[98325]: pxa270-c0 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a15 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa270-b0 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a57 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-m4 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa270-a0 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: arm1176 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa270-b1 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a7 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa270-a1 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a76 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: a64fx Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a8 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: neoverse-v1 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-r5 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: ti925t Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-r5f Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: arm1026 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a9 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-m7 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa270 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa260 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa250 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa270-c5 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa261 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: pxa262 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a710 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: sa1110 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-r52 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: sa1100 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: max Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-a53 Jun 09 11:44:26.718190 np0000002435 nova-compute[98325]: cortex-m0 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cortex-m33 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cortex-a72 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: arm946 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: pxa255 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cortex-a55 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: arm11mpcore Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cortex-m55 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: neoverse-n1 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: arm926 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: arm1136 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cortex-a35 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: arm1136-r2 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cortex-m3 Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.718968 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: Jun 09 11:44:26.720050 np0000002435 nova-compute[98325]: 2 Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: 3 Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-cris Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: axis-dev88 Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: cris Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.721569 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.723692 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-i386 Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: pc-i440fx-noble Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: i686 Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.725170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.726250 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.727143 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.727978 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.729105 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-i386 Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: pc-q35-noble Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: i686 Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.731065 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.733211 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.734138 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.734835 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.735950 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-i386 Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: pc-q35-noble-v2 Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: i686 Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.737618 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.738729 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.739970 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.740627 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: Jun 09 11:44:26.741856 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-i386 Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: pc-i440fx-noble-v2 Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: i686 Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.743483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.744724 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.746493 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.747220 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: Jun 09 11:44:26.748167 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-m68k Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: mcf5208evb Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: m68k Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.749389 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.750483 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-m68k Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: virt-8.2 Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: m68k Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.751818 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.753404 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-microblaze Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: petalogix-s3adsp1800 Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: microblaze Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.754953 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.755910 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-microblazeel Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: petalogix-s3adsp1800 Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: microblazeel Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.757204 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.758196 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mips Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: mips Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.760351 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.761328 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mipsel Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: mipsel Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.763840 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: Jun 09 11:44:26.765345 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mips64 Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: mips64 Jun 09 11:44:26.766775 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.771363 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.773024 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-mips64el Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: malta Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: mips64el Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.774195 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.775101 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: g3beige Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: ppc Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: Jun 09 11:44:26.776222 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: Jun 09 11:44:26.777121 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64 Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: pseries-noble Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: ppc64 Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.778347 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: POWER10 Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: POWER9 Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: POWER8 Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: POWER7 Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.779221 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: tpm-spapr Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: spapr-tpm-proxy Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.783250 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: powernv9 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: ppc64 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: POWER10 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: POWER9 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: POWER8 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: POWER7 Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.785001 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: tpm-spapr Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: spapr-tpm-proxy Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.786725 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64 Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: pseries-noble Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: ppc64 Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: POWER10 Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: POWER9 Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: POWER8 Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: POWER7 Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.788597 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: Jun 09 11:44:26.790232 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: tpm-spapr Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: spapr-tpm-proxy Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64le Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.792308 np0000002435 nova-compute[98325]: powernv9 Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: ppc64le Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: POWER10 Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: POWER9 Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: POWER8 Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: POWER7 Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.793871 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: tpm-spapr Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: spapr-tpm-proxy Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.795629 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-ppc64le Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: pseries-noble Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: ppc64le Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: POWER10 Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: POWER9 Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: POWER8 Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: POWER7 Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: Jun 09 11:44:26.797459 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: tpm-spapr Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: spapr-tpm-proxy Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.799072 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-riscv32 Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: riscv32 Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.800521 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.801581 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: Jun 09 11:44:26.802795 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-riscv64 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: virt Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: riscv64 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: rv64 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: sifive-e51 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: any Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: x-rv128 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: shakti-c Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: max Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: thead-c906 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: sifive-u54 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: veyron-v1 Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.804079 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.805129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-s390x Jun 09 11:44:26.806368 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: s390-ccw-virtio-noble Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: s390x Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z13 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z990.3 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z13-base Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z990.2 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z196.2-base Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z14 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z14.2-base Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z990.4 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z196 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z10BC.2-base Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z114-base Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: gen16b Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z890.3-base Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: gen16a Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z990.5 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z196.2 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: zEC12 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: zEC12.2 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z9EC.2 Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z9BC Jun 09 11:44:26.807254 np0000002435 nova-compute[98325]: z9EC.3-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z800-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z14ZR1-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z890 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z990.4-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z9EC.3 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z13.2 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z10BC.2 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: gen15a-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z14.2 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: zBC12-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: gen16a-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z900.3 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z196-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z990 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z14-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z900.2 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z800 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z10EC Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z14ZR1 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z900 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z10EC.2 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z10EC.2-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z900.2-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z900-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z10EC.3 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z990.5-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: max Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: gen15b Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z9BC.2-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: gen15a Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z990.2-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z10EC-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: gen16b-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z114 Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z9EC-base Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: z13s Jun 09 11:44:26.808295 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: gen15b-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: zEC12-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z890.3 Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z10EC.3-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z890.2-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z890.2 Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z10BC-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: zEC12.2-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z890-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z9BC-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z10BC Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z9EC Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z9EC.2-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z13.2-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z900.3-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z990.3-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z13s-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: zBC12 Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z990-base Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: z9BC.2 Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.809047 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.810129 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sh4 Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: shix Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: sh4 Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: Jun 09 11:44:26.811588 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.812635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sh4eb Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: shix Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: sh4eb Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.814024 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.815082 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sparc Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: SS-5 Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: sparc Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.816365 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.817428 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-sparc64 Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: sun4u Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: sparc64 Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.818803 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.819830 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-x86_64 Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: pc-i440fx-noble Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: x86_64 Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: efi Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 09 11:44:26.821179 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.822749 np0000002435 nova-compute[98325]: Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.823734 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.824662 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.825503 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-x86_64 Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: pc-q35-noble Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: x86_64 Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: efi Jun 09 11:44:26.827155 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: /usr/share/ovmf/OVMF.amdsev.fd Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.828341 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.829250 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: Jun 09 11:44:26.829878 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.830635 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jun 09 11:44:26.832015 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-x86_64 Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: pc-q35-noble-v2 Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: x86_64 Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: efi Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: /usr/share/ovmf/OVMF.amdsev.fd Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.833170 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.834140 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Jun 09 11:44:26.834769 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.835361 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.836932 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-x86_64 Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: pc-i440fx-noble-v2 Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: x86_64 Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: efi Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: on Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: off Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.838175 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: qemu64 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: qemu32 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: phenom Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: pentium3 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: pentium2 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: pentium Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: n270 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: kvm64 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: kvm32 Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: coreduo Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: core2duo Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: athlon Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Westmere-IBRS Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Westmere Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Snowridge Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Skylake-Server-noTSX-IBRS Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Skylake-Server-IBRS Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Skylake-Server Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Skylake-Client-noTSX-IBRS Jun 09 11:44:26.839133 np0000002435 nova-compute[98325]: Skylake-Client-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Skylake-Client Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: SapphireRapids Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: SandyBridge-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: SandyBridge Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Penryn Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Opteron_G5 Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Opteron_G4 Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Opteron_G3 Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Opteron_G2 Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Opteron_G1 Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Nehalem-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: IvyBridge-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: IvyBridge Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Icelake-Server-noTSX Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Icelake-Server Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Haswell-noTSX-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Haswell-noTSX Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Haswell-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Haswell Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: EPYC-Rome Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: EPYC-Milan Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: EPYC-IBPB Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: EPYC-Genoa Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: EPYC Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Dhyana Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Cooperlake Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Conroe Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Cascadelake-Server-noTSX Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Cascadelake-Server Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Broadwell-noTSX-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Broadwell-noTSX Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Broadwell-IBRS Jun 09 11:44:26.839808 np0000002435 nova-compute[98325]: Broadwell Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: 486 Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: ide Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.840382 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: tpm-tis Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: tpm-crb Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: passthrough Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: emulator Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: external Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: 1.2 Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: 2.0 Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: relaxed Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: vapic Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: spinlocks Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: vpindex Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: runtime Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: synic Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: stimer Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: reset Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: vendor_id Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: frequencies Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: reenlightenment Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: tlbflush Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: ipi Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: avic Jun 09 11:44:26.841658 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-xtensa Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: sim Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: xtensa Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.842938 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.843923 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98325) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-xtensaeb Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: sim Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: xtensaeb Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: rom Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: pflash Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: yes Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: no Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: file Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: anonymous Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: memfd Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.845180 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: disk Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: cdrom Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: floppy Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: lun Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: fdc Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: sata Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: sdl Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: vnc Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: spice Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: egl-headless Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: dbus Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: subsystem Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: default Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: mandatory Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: requisite Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: optional Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: pci Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: scsi Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio-transitional Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtio-non-transitional Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: random Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: egd Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: path Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: handle Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: virtiofs Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.846206 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: usb Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: pty Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: unix Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: spicevmc Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: virtio Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: qemu Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: builtin Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: {{(pid=98325) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Checking secure boot support for host arch (x86_64) {{(pid=98325) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Checking secure boot support for host arch (x86_64) {{(pid=98325) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Checking secure boot support for host arch (x86_64) {{(pid=98325) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 09 11:44:26.847496 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Secure Boot support detected Jun 09 11:44:27.284924 np0000002435 nova-compute[98325]: INFO nova.virt.node [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Generated node identity d3492327-ddbb-4ac4-8f97-93fcb625bcd0 Jun 09 11:44:27.285138 np0000002435 nova-compute[98325]: INFO nova.virt.node [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Wrote node identity d3492327-ddbb-4ac4-8f97-93fcb625bcd0 to /opt/stack/data/nova/compute_id Jun 09 11:44:27.787395 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Compute nodes ['d3492327-ddbb-4ac4-8f97-93fcb625bcd0'] for host np0000002435 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jun 09 11:44:28.791476 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jun 09 11:44:29.796374 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] No compute node record found for host np0000002435. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000002435 could not be found. Jun 09 11:44:29.796911 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:44:29.796911 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:44:29.796911 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:44:29.796984 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:44:29.854457 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:44:29.855303 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:44:29.866974 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] CMD "env LANG=C uptime" returned: 0 in 0.011s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:44:29.867325 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Hypervisor/Node resource view: name=np0000002435 free_ram=16621MB free_disk=75.15853881835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:44:29.867470 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:44:29.867686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:44:30.370681 np0000002435 nova-compute[98325]: WARNING nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] No compute node record for np0000002435:d3492327-ddbb-4ac4-8f97-93fcb625bcd0: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d3492327-ddbb-4ac4-8f97-93fcb625bcd0 could not be found. Jun 09 11:44:30.876285 np0000002435 nova-compute[98325]: INFO nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Compute node record created for np0000002435:np0000002435 with uuid: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 Jun 09 11:44:32.383829 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:44:32.384407 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:44:29 up 27 min, 2 users, load average: 2.08, 1.34, 0.68\n'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:44:32.866663 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] [req-90f5a5c9-b250-4db9-b9c6-20d70a7cb7ea] Created resource provider record via placement API for resource provider with UUID d3492327-ddbb-4ac4-8f97-93fcb625bcd0 and name np0000002435. Jun 09 11:44:32.915580 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] /sys/module/kvm_amd/parameters/sev contains [N Jun 09 11:44:32.915580 np0000002435 nova-compute[98325]: ] {{(pid=98325) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jun 09 11:44:32.915722 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.host [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] kernel doesn't support AMD SEV Jun 09 11:44:32.915913 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:44:32.916077 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Updating inventory in ProviderTree for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 09 11:44:32.916334 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Libvirt baseline CPU Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: x86_64 Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: AMD Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: Jun 09 11:44:32.920698 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13766}} Jun 09 11:44:33.488018 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Updated inventory for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} Jun 09 11:44:33.488449 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Updating resource provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 generation from 0 to 1 during operation: update_inventory {{(pid=98325) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 09 11:44:33.488449 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Updating inventory in ProviderTree for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 09 11:44:33.627351 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Updating resource provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 generation from 1 to 2 during operation: update_traits {{(pid=98325) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 09 11:44:34.135786 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:44:34.135943 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.268s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:44:34.136172 np0000002435 nova-compute[98325]: DEBUG nova.service [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98325) start /opt/stack/nova/nova/service.py:195}} Jun 09 11:44:34.150134 np0000002435 nova-compute[98325]: DEBUG nova.service [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98325) start /opt/stack/nova/nova/service.py:211}} Jun 09 11:44:34.163999 np0000002435 nova-compute[98325]: DEBUG nova.service [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] Join ServiceGroup membership for this service compute {{(pid=98325) start /opt/stack/nova/nova/service.py:221}} Jun 09 11:44:34.164530 np0000002435 nova-compute[98325]: DEBUG nova.servicegroup.drivers.db [None req-243ddb4e-c475-4d56-b348-6536a6b31e0f None None] DB_Driver: join new ServiceGroup member np0000002435 to the compute group, service = {{(pid=98325) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 09 11:44:39.166825 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:44:39.668787 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:44:39.675376 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:44:39.676889 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 34.12 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:45:13.800306 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.801397 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.801397 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.801934 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.801934 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.802185 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.802541 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:13.802541 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:45:13.802752 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:45:14.307121 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:45:14.307121 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:45:14.307121 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:45:14.307121 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:45:14.314272 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:45:14.317276 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:45:14.330236 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:45:14.330830 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=16394MB free_disk=75.00253295898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:45:14.331177 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:45:14.331494 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:45:15.381316 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:45:15.381316 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:45:14 up 27 min, 2 users, load average: 1.82, 1.37, 0.73\n'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:45:15.423327 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:45:15.423327 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:45:15.927289 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:45:16.431191 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:45:16.431191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.100s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:45:16.432064 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:46:16.424698 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.425310 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.425396 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.425667 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.425910 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.426149 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.426399 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.426628 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.426747 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:46:16.426907 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:46:16.930291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:16.931451 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:16.931451 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:16.931451 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:46:16.937945 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:46:16.938690 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:16.954768 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:16.955135 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=16349MB free_disk=74.79953384399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:46:16.955309 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:16.955534 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:18.002280 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:46:18.002644 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:46:16 up 28 min, 2 users, load average: 1.13, 1.27, 0.73\n'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:46:18.042710 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:18.042909 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:18.545292 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:19.050900 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:46:19.051398 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.096s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:19.051398 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:46:39.671258 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:46:43.625529 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:43.626028 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:43.833813 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:43.834113 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:44.128481 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:44.336483 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:44.691116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:44.691546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:44.694289 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:44.694496 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Claim successful on node np0000002435 Jun 09 11:46:44.883438 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:45.565557 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:45.565733 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:45.937814 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:45.938155 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:46.067009 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:46.238566 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:46.238780 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:46.441157 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:46.636273 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:46.741072 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:46.950364 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.258s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:46.950763 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.067s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:46.951001 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:46:46.955692 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:46.955879 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Claim successful on node np0000002435 Jun 09 11:46:47.299990 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:47.457920 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:46:47.458525 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:46:47.459320 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:47.462010 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:47.979014 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:46:48.143548 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbd75a95df64400a7a3db15ee91196e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b166f86497e4dbfb0ea7e1850584656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:46:48.228883 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:48.228883 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:48.487502 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:46:48.732459 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:48.816470 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Successfully created port: e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:46:49.152429 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:49.152778 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:49.240810 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.289s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:49.240810 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:46:49.241982 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.606s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:49.245810 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:49.245917 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Claim successful on node np0000002435 Jun 09 11:46:49.496616 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:46:49.498090 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:46:49.498626 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Creating image(s) Jun 09 11:46:49.499157 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "/opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:49.499384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:49.500007 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:49.500482 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:49.500989 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:49.654662 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:49.716588 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Successfully updated port: e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:46:49.744389 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:46:49.745635 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:46:49.746291 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:49.746506 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:49.802034 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:49.805163 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:49.805593 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:49.842400 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5ac4f1fac1e4dfbbc2e97d1aaa39971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec66aa0aa54ed1b5f0ca42b1f529a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:46:49.870785 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.part --force-share --output=json" returned: 0 in 0.065s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:49.871385 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] b8dcd603-8bb0-4f2a-bfa2-115620ecccb4 was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:46:49.873154 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:46:49.873154 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.part /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:49.990499 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.part /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.converted" returned: 0 in 0.117s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:49.995559 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:50.050340 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66.converted --force-share --output=json" returned: 0 in 0.054s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:50.051154 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.550s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:50.051784 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:50.054788 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:50.055784 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpksgrdhr5/privsep.sock'] Jun 09 11:46:50.064085 np0000002435 sudo[109902]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpksgrdhr5/privsep.sock Jun 09 11:46:50.064695 np0000002435 sudo[109902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 09 11:46:50.207633 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:50.224249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-54835fc7-b0b9-4113-90ad-797bdac45590" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:50.224249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-54835fc7-b0b9-4113-90ad-797bdac45590" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:50.224249 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:46:50.246986 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:46:50.303624 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 09 11:46:50.303703 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 09 11:46:50.303772 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 09 11:46:50.303872 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:50.303954 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 09 11:46:50.304016 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 09 11:46:50.304091 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 09 11:46:50.304165 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:50.304252 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 09 11:46:50.329209 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-changed-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:50.329406 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Refreshing instance network info cache due to event network-changed-e5319a59-cd4b-4855-be1e-9107dd976810. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:46:50.329832 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] Acquiring lock "refresh_cache-54835fc7-b0b9-4113-90ad-797bdac45590" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:50.418565 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Successfully created port: 5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:46:50.571280 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:50.571280 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:50.599436 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 09 11:46:50.599698 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 09 11:46:50.599792 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 09 11:46:50.599868 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:50.599940 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 09 11:46:50.600009 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 09 11:46:50.600089 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 09 11:46:50.600173 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:50.600245 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 09 11:46:50.750467 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:46:50.815050 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:46:50.820644 np0000002435 sudo[109902]: pam_unix(sudo:session): session closed for user root Jun 09 11:46:50.821917 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Spawned new privsep daemon via rootwrap Jun 09 11:46:50.822764 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 09 11:46:50.822899 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 09 11:46:50.823149 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 09 11:46:50.823319 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109910 Jun 09 11:46:50.900339 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Successfully updated port: 5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:46:50.923298 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:50.982889 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.061s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:50.983387 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:50.983818 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:50.984172 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:50.986572 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:50.986862 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.049571 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.062s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.050053 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.073880 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:51.077598 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:51.084174 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk 1073741824" returned: 0 in 0.034s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.084844 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.101s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:51.085435 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.156797 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.071s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.158489 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:46:51.158758 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.226009 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.226507 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Cannot resize image /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:46:51.226957 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:46:51.227123 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Ensure instance console log exists: /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:46:51.227397 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:51.227753 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:51.227753 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:51.306714 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Updating instance_info_cache with network_info: [{"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:51.401622 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "refresh_cache-dae1d031-f9ec-4441-878d-be97ec49b42f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:51.401727 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquired lock "refresh_cache-dae1d031-f9ec-4441-878d-be97ec49b42f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:51.401878 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:46:51.586929 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.345s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:51.587617 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:46:51.590153 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.287s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:51.595570 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:51.595736 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Claim successful on node np0000002435 Jun 09 11:46:51.761954 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:46:51.762889 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:46:51.763101 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Creating image(s) Jun 09 11:46:51.763537 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "/opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:51.763673 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "/opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:51.764108 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "/opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:51.764612 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:51.767628 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:51.768976 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.810073 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-54835fc7-b0b9-4113-90ad-797bdac45590" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:51.810616 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Instance network_info: |[{"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:46:51.811020 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] Acquired lock "refresh_cache-54835fc7-b0b9-4113-90ad-797bdac45590" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:51.813442 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Start _get_guest_xml network_info=[{"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:46:51.814083 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Refreshing network info cache for port e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:46:51.817518 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:46:51.821043 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-733231394', uuid='54835fc7-b0b9-4113-90ad-797bdac45590'), owner=OwnerMeta(userid='ddbd75a95df64400a7a3db15ee91196e', username='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member', projectid='4b166f86497e4dbfb0ea7e1850584656', projectname='tempest-ServerBootFromVolumeStableRescueTest-252292105'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005611.820187) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:46:51.821882 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:46:51.822170 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:46:51.822956 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:46:51.823355 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:46:51.824502 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:46:51.825010 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:46:51.825141 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:46:51.825226 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:46:51.825347 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:46:51.825428 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:46:51.825501 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:46:51.825647 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:46:51.825764 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:46:51.826016 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:46:51.826113 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:46:51.826210 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:46:51.833063 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.064s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.835275 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:51.836585 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:51.837066 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:51.840075 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:51.840521 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.851143 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:46:51.852316 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733231394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-733231394',id=1,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-kebpdl2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:49Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=54835fc7-b0b9-4113-90ad-797bdac45590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:46:51.852529 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:51.853698 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:51.854737 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'pci_devices' on Instance uuid 54835fc7-b0b9-4113-90ad-797bdac45590 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:46:51.897909 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.057s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.898320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.922780 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk 1073741824" returned: 0 in 0.024s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.923312 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.087s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:51.923656 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:51.985009 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.061s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:51.985644 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:46:51.986042 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:52.036102 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:46:52.059170 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:52.059508 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Cannot resize image /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:46:52.059817 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:46:52.059950 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Ensure instance console log exists: /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:46:52.060381 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:52.060381 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:52.060495 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:52.095212 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:46:52.095411 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:46:52.095756 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:52.096015 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:52.110223 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:52.110484 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:52.168753 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35bde36378d547078d9410928ae16735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97413552cb514828acbb1e9f9de02eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:46:52.280153 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:52.318102 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] End _get_guest_xml xml= Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 54835fc7-b0b9-4113-90ad-797bdac45590 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: instance-00000001 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 196608 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-server-733231394 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 2026-06-09 11:46:51 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 192 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: True Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: bare Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: virtio Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 54835fc7-b0b9-4113-90ad-797bdac45590 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 54835fc7-b0b9-4113-90ad-797bdac45590 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: hvm Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 128 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: Jun 09 11:46:52.359019 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:46:52.361213 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Preparing to wait for external event network-vif-plugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:46:52.361213 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:52.361213 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:52.361213 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:52.361213 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733231394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-733231394',id=1,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-kebpdl2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:49Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=54835fc7-b0b9-4113-90ad-797bdac45590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:46:52.361456 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:52.361509 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:52.361846 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:46:52.411183 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Created schema index Interface.name {{(pid=98325) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 09 11:46:52.411331 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Created schema index Port.name {{(pid=98325) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 09 11:46:52.411459 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Created schema index Bridge.name {{(pid=98325) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 09 11:46:52.411937 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98325) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 09 11:46:52.412111 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [POLLOUT] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.412223 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98325) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 09 11:46:52.412650 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.414342 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.439399 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-changed-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:52.439531 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Refreshing instance network info cache due to event network-changed-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:46:52.439680 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] Acquiring lock "refresh_cache-dae1d031-f9ec-4441-878d-be97ec49b42f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:52.440034 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.461087 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.463297 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:52.463297 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:46:52.463297 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.463297 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8af3228f-085f-5e21-8bc6-6952d2a28bf8', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:52.464781 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:52.464781 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:52.465721 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxr578ajq/privsep.sock'] Jun 09 11:46:52.473408 np0000002435 sudo[109969]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxr578ajq/privsep.sock Jun 09 11:46:52.474130 np0000002435 sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 09 11:46:52.557388 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Updating instance_info_cache with network_info: [{"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:52.606308 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:46:52.614199 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:52.754173 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 09 11:46:52.754257 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 09 11:46:52.754257 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 09 11:46:52.754455 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:52.754507 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 09 11:46:52.754863 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 09 11:46:52.754863 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 09 11:46:52.754863 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:52.754863 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 09 11:46:52.889338 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Successfully created port: 0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:46:52.909078 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:53.008601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:53.008904 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:53.062546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Releasing lock "refresh_cache-dae1d031-f9ec-4441-878d-be97ec49b42f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:53.062546 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Instance network_info: |[{"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:46:53.063404 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] Acquired lock "refresh_cache-dae1d031-f9ec-4441-878d-be97ec49b42f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:53.063404 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Refreshing network info cache for port 5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:46:53.065906 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Start _get_guest_xml network_info=[{"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:46:53.066548 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 09 11:46:53.066609 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 09 11:46:53.066645 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 09 11:46:53.066831 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:53.066831 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 09 11:46:53.067119 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 09 11:46:53.067119 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 09 11:46:53.067119 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:53.067119 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 09 11:46:53.068544 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:46:53.070000 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-896162405', uuid='dae1d031-f9ec-4441-878d-be97ec49b42f'), owner=OwnerMeta(userid='b5ac4f1fac1e4dfbbc2e97d1aaa39971', username='tempest-ServersNegativeTestJSON-2084585060-project-member', projectid='82ec66aa0aa54ed1b5f0ca42b1f529a9', projectname='tempest-ServersNegativeTestJSON-2084585060'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005613.0695837) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:46:53.071877 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:46:53.072256 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:46:53.074408 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:46:53.074755 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:46:53.078508 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:46:53.079213 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:46:53.079390 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:46:53.079512 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:46:53.079991 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:46:53.082735 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:46:53.082921 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:46:53.083355 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:46:53.083493 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:46:53.083638 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:46:53.083773 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:46:53.083946 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:46:53.106944 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-896162405',display_name='tempest-ServersNegativeTestJSON-server-896162405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serversnegativetestjson-server-896162405',id=2,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ec66aa0aa54ed1b5f0ca42b1f529a9',ramdisk_id='',reservation_id='r-9cvdaxj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2084585060',owner_user_name='tempest-ServersNegativeTestJSON-2084585060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:51Z,user_data=None,user_id='b5ac4f1fac1e4dfbbc2e97d1aaa39971',uuid=dae1d031-f9ec-4441-878d-be97ec49b42f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:46:53.107188 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converting VIF {"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:53.108130 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:53.108997 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lazy-loading 'pci_devices' on Instance uuid dae1d031-f9ec-4441-878d-be97ec49b42f {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:46:53.115297 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:46:53.124380 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Updated VIF entry in instance network info cache for port e5319a59-cd4b-4855-be1e-9107dd976810. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:46:53.124622 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Updating instance_info_cache with network_info: [{"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:53.135127 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.177679 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:53.297639 np0000002435 sudo[109969]: pam_unix(sudo:session): session closed for user root Jun 09 11:46:53.299456 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Spawned new privsep daemon via rootwrap Jun 09 11:46:53.300548 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 09 11:46:53.300548 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 09 11:46:53.301032 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jun 09 11:46:53.301032 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109984 Jun 09 11:46:53.420727 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Successfully updated port: 0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:46:53.511709 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:53.552727 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.552973 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5319a59-cd, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.553370 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5319a59-cd, col_values=(('qos', UUID('86ccf1aa-86f3-4723-bdfe-901d639c86c5')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.554368 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5319a59-cd, col_values=(('external_ids', {'iface-id': 'e5319a59-cd4b-4855-be1e-9107dd976810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:75:ab', 'vm-uuid': '54835fc7-b0b9-4113-90ad-797bdac45590'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.556172 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.558360 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:53.561540 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.562606 np0000002435 nova-compute[98325]: INFO os_vif [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') Jun 09 11:46:53.569055 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] End _get_guest_xml xml= Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: dae1d031-f9ec-4441-878d-be97ec49b42f Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: instance-00000002 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 196608 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: tempest-ServersNegativeTestJSON-server-896162405 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 2026-06-09 11:46:53 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 192 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: True Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: bare Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: virtio Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: tempest-ServersNegativeTestJSON-2084585060-project-member Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: tempest-ServersNegativeTestJSON-2084585060 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: dae1d031-f9ec-4441-878d-be97ec49b42f Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: dae1d031-f9ec-4441-878d-be97ec49b42f Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: hvm Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 128 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: Jun 09 11:46:53.611638 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:46:53.613546 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Preparing to wait for external event network-vif-plugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:46:53.613546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:53.613546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:53.613546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:53.613546 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-896162405',display_name='tempest-ServersNegativeTestJSON-server-896162405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serversnegativetestjson-server-896162405',id=2,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ec66aa0aa54ed1b5f0ca42b1f529a9',ramdisk_id='',reservation_id='r-9cvdaxj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2084585060',owner_user_name='tempest-ServersNegativeTestJSON-2084585060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:51Z,user_data=None,user_id='b5ac4f1fac1e4dfbbc2e97d1aaa39971',uuid=dae1d031-f9ec-4441-878d-be97ec49b42f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:46:53.613829 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converting VIF {"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:53.613829 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:53.613906 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:46:53.614751 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.615045 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.615641 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:46:53.616501 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.616721 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73fc388f-28eb-57ab-a35f-5bc3593ac5fd', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.620143 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.620900 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:53.625905 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.627862 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9083dc40-fd6b-4c31-9cdb-a6246eaae74c req-7567ab34-add6-4061-b49a-64e4cea25104 service nova] Releasing lock "refresh_cache-54835fc7-b0b9-4113-90ad-797bdac45590" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:53.629627 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.629922 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed2f3a2-a9, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.630836 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ed2f3a2-a9, col_values=(('qos', UUID('ee892d9a-cec9-4720-9460-1bc64daa58d7')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.630836 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ed2f3a2-a9, col_values=(('external_ids', {'iface-id': '5ed2f3a2-a9d6-4f3a-b967-2427b009b18b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:86:b6', 'vm-uuid': 'dae1d031-f9ec-4441-878d-be97ec49b42f'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:53.632340 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.634304 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:53.644416 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:53.646536 np0000002435 nova-compute[98325]: INFO os_vif [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') Jun 09 11:46:53.664751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:53.664751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:53.876940 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:53.921400 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:53.921543 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:53.921605 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:46:54.022303 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.435s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:54.022785 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.815s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:54.022920 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:46:54.027240 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:54.027567 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Claim successful on node np0000002435 Jun 09 11:46:54.085533 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Updated VIF entry in instance network info cache for port 5ed2f3a2-a9d6-4f3a-b967-2427b009b18b. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:46:54.085830 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Updating instance_info_cache with network_info: [{"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:54.123450 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:46:54.124439 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:46:54.124717 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Creating image(s) Jun 09 11:46:54.125111 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:54.125233 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:54.125751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:54.126638 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:54.130367 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:54.131320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:54.168236 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:46:54.204281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.073s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:54.204752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:54.205227 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:54.205773 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:54.209877 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:54.210244 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:54.278851 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.068s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:54.279251 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:54.306658 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk 1073741824" returned: 0 in 0.027s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:54.307066 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.102s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:54.307354 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:54.368827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.061s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:54.369484 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:46:54.369756 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:54.435712 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:54.437450 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Cannot resize image /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:46:54.437513 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:46:54.437651 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Ensure instance console log exists: /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:46:54.437991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:54.438189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:54.439108 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:54.505832 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:54.505950 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing instance network info cache due to event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:46:54.506086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:54.508532 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:46:54.531119 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:46:54.531885 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:46:54.535093 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:54.535468 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:54.588087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-08be40c4-52de-4919-8428-dadb1c7c1ffd req-ab4d913b-b89f-4736-9f25-787b94606f1f service nova] Releasing lock "refresh_cache-dae1d031-f9ec-4441-878d-be97ec49b42f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:54.653654 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddafbf9dd6d14df9aa70526de4ceade9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6342a70d63478b87507cf6ab897736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:46:54.713115 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:54.730163 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:54.882331 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:55.035181 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:46:55.080430 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:46:55.080430 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:46:55.080430 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No VIF found with MAC fa:16:3e:08:75:ab, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:46:55.080430 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Using config drive Jun 09 11:46:55.181780 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:46:55.181969 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:46:55.182065 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] No VIF found with MAC fa:16:3e:60:86:b6, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:46:55.182478 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Using config drive Jun 09 11:46:55.228274 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.384445 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:55.384772 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance network_info: |[{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:46:55.387021 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Start _get_guest_xml network_info=[{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:46:55.387532 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:55.387662 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:46:55.389596 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:46:55.390855 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1777809667', uuid='f973e06e-5d44-4393-abce-509f80f2db62'), owner=OwnerMeta(userid='35bde36378d547078d9410928ae16735', username='tempest-ServerStableDeviceRescueTest-1966995700-project-member', projectid='97413552cb514828acbb1e9f9de02eda', projectname='tempest-ServerStableDeviceRescueTest-1966995700'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005615.3904617) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:46:55.391669 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:46:55.392020 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:46:55.394025 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:46:55.394208 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:46:55.395120 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:46:55.395438 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:46:55.395937 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:46:55.396066 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:46:55.396189 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:46:55.396279 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:46:55.396375 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:46:55.396512 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:46:55.396601 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:46:55.396723 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:46:55.396820 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:46:55.396989 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:46:55.413687 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1777809667',display_name='tempest-ServerStableDeviceRescueTest-server-1777809667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverstabledevicerescuetest-server-1777809667',id=3,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJog5LRUAJnLmramI+tIZTLsBkK1S9u9VYhQUeQnru8fu1pzGmBeKQpQnutdjX4MSEKGyJSOMEFot91cm+xXvwnMDRWoriySF2F/yPHgLWnjp5o5PnYp+pq7xgFFTt/cw==',key_name='tempest-keypair-895276484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97413552cb514828acbb1e9f9de02eda',ramdisk_id='',reservation_id='r-ax4xbky3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1966995700',owner_user_name='tempest-ServerStableDeviceRescueTest-1966995700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35bde36378d547078d9410928ae16735',uuid=f973e06e-5d44-4393-abce-509f80f2db62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:46:55.413687 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converting VIF {"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:55.413687 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:55.414103 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'pci_devices' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:46:55.424861 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:55.424861 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:55.431285 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.482932 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Successfully created port: dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:46:55.540280 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:46:55.584878 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:55.688279 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:55.890169 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] End _get_guest_xml xml= Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: instance-00000003 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 196608 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: tempest-ServerStableDeviceRescueTest-server-1777809667 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 2026-06-09 11:46:55 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 192 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: True Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: bare Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: virtio Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: tempest-ServerStableDeviceRescueTest-1966995700-project-member Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: tempest-ServerStableDeviceRescueTest-1966995700 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: hvm Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 128 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: Jun 09 11:46:55.919435 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:46:55.923275 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Preparing to wait for external event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:46:55.923275 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:55.923275 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:55.923275 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:55.923275 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1777809667',display_name='tempest-ServerStableDeviceRescueTest-server-1777809667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverstabledevicerescuetest-server-1777809667',id=3,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJog5LRUAJnLmramI+tIZTLsBkK1S9u9VYhQUeQnru8fu1pzGmBeKQpQnutdjX4MSEKGyJSOMEFot91cm+xXvwnMDRWoriySF2F/yPHgLWnjp5o5PnYp+pq7xgFFTt/cw==',key_name='tempest-keypair-895276484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97413552cb514828acbb1e9f9de02eda',ramdisk_id='',reservation_id='r-ax4xbky3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1966995700',owner_user_name='tempest-ServerStableDeviceRescueTest-1966995700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35bde36378d547078d9410928ae16735',uuid=f973e06e-5d44-4393-abce-509f80f2db62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:46:55.923568 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converting VIF {"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:55.923568 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:55.923568 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:46:55.924465 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.924816 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:55.925063 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:46:55.925609 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.925768 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33b34444-dbbf-5843-9e54-198dc4f09d91', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:55.927737 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:55.932507 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.933679 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:55.938287 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.943154 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.943363 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e7cee76-43, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:55.943643 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e7cee76-43, col_values=(('qos', UUID('4e1be85b-0d74-4503-a193-fa78abf650ff')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:55.943782 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e7cee76-43, col_values=(('external_ids', {'iface-id': '0e7cee76-43d3-41de-96b9-771f91b176fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:5a:d3', 'vm-uuid': 'f973e06e-5d44-4393-abce-509f80f2db62'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:55.944573 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.945956 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:55.961523 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:55.962931 np0000002435 nova-compute[98325]: INFO os_vif [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') Jun 09 11:46:55.972929 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Successfully updated port: dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:46:56.027813 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Creating config drive at /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk.config Jun 09 11:46:56.032553 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxwrez8_s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.058893 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxwrez8_s" returned: 0 in 0.026s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.291183 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:56.396235 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Creating config drive at /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk.config Jun 09 11:46:56.400087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa9q5j3zf {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.426822 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa9q5j3zf" returned: 0 in 0.026s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.431537 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updated VIF entry in instance network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:46:56.432173 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:56.435570 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.413s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:56.435881 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:46:56.438339 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.261s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:56.442196 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:56.442391 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Claim successful on node np0000002435 Jun 09 11:46:56.478613 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:56.478613 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:56.478613 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:46:56.487355 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:56.518717 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:56.551368 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:46:56.552283 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:46:56.552504 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Creating image(s) Jun 09 11:46:56.552917 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:56.553036 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:56.553449 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:56.554296 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:56.557937 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:56.559486 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.621764 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-changed-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:56.625715 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.066s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.626622 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Refreshing instance network info cache due to event network-changed-dfc607e9-d1c6-474b-b876-d24787b0e300. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:46:56.626622 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:56.626896 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:56.626999 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:56.627374 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:56.630546 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:46:56.631204 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] No event matching network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 in dict_keys([('network-vif-plugged', 'e5319a59-cd4b-4855-be1e-9107dd976810')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received unexpected event network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 for instance with vm_state building and task_state spawning. Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:56.661549 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] No event matching network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b in dict_keys([('network-vif-plugged', '5ed2f3a2-a9d6-4f3a-b967-2427b009b18b')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:46:56.662085 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ffba38e2-e372-48cf-99b2-bbc5f654fa7b req-9f0aeb6f-7cac-495e-82f8-89d274ac6c69 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received unexpected event network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b for instance with vm_state building and task_state spawning. Jun 09 11:46:56.692669 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:56.704804 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.074s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.705135 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.716107 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:56.741431 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk 1073741824" returned: 0 in 0.035s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.742683 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.115s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:56.742683 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.805555 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.063s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.809281 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:46:56.809281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:56.864313 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.057s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:56.864719 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Cannot resize image /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:46:56.865188 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:46:56.865363 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Ensure instance console log exists: /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:46:56.865619 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:56.865857 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:56.866030 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:56.939592 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-20c0e957-71b3-4ec4-9a28-8ddb13632d4d req-118b4935-b632-4023-9730-e7151567e3ba service nova] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:56.943584 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:46:56.943931 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:46:56.944449 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:56.944902 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:57.024125 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:57.047224 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d422c8cd17d4fe5b548032f10c7c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3020791dcd4ef4b7980dd196a8ca96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:46:57.051630 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:57.066288 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:46:57.145939 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:57.341604 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:57.449313 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:46:57.490914 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:46:57.490914 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:46:57.493422 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No VIF found with MAC fa:16:3e:d0:5a:d3, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:46:57.493422 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Using config drive Jun 09 11:46:57.593895 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:57.828846 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:46:57.829917 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] VM Started (Lifecycle Event) Jun 09 11:46:57.855789 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Successfully created port: 25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:46:57.897683 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:46:57.898101 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:46:57.954720 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:46:57.999291 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:58.096176 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:58.096420 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance network_info: |[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:46:58.096812 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:58.097007 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Refreshing network info cache for port dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:46:58.099478 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start _get_guest_xml network_info=[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:46:58.103964 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:46:58.103964 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1443682971', uuid='c5797bda-6c93-417f-be59-a3c76be89e7e'), owner=OwnerMeta(userid='ddafbf9dd6d14df9aa70526de4ceade9', username='tempest-ServerActionsTestOtherB-436431080-project-member', projectid='ef6342a70d63478b87507cf6ab897736', projectname='tempest-ServerActionsTestOtherB-436431080'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005618.103498) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:46:58.104634 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:46:58.105035 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:46:58.110287 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:46:58.120535 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:46:58.120938 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:58.121602 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:58.123110 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'pci_devices' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:46:58.161626 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Creating config drive at /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config Jun 09 11:46:58.165247 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7b5q0qf9 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:58.190475 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7b5q0qf9" returned: 0 in 0.025s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:46:58.336713 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:46:58.338818 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:46:58.338957 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] VM Paused (Lifecycle Event) Jun 09 11:46:58.362991 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Successfully updated port: 25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:46:58.401214 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:46:58.459856 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Booting with volume 37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 at /dev/vda Jun 09 11:46:58.525689 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:46:58.526312 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpk7aagein/privsep.sock'] Jun 09 11:46:58.536232 np0000002435 sudo[110254]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpk7aagein/privsep.sock Jun 09 11:46:58.537087 np0000002435 sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 09 11:46:58.600668 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:58.624772 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] End _get_guest_xml xml= Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: instance-00000004 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 196608 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-server-1443682971 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 2026-06-09 11:46:58 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 192 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: True Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: bare Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 0 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: virtio Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-436431080-project-member Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-436431080 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: hvm Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 128 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: 1 Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Preparing to wait for external event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:58.628320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:58.630211 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:46:58.630211 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:46:58.630211 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:46:58.630512 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:46:58.637474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.637474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:58.637474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:46:58.637474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.637474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd07d40ff-ad4b-5819-a915-ea20a990d6b9', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:58.637474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.641439 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:58.644322 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.644563 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc607e9-d1, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:58.644787 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfc607e9-d1, col_values=(('qos', UUID('a84ec1b3-329c-41bb-a29e-37d7ac9cae7e')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:58.645000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfc607e9-d1, col_values=(('external_ids', {'iface-id': 'dfc607e9-d1c6-474b-b876-d24787b0e300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f9:9d', 'vm-uuid': 'c5797bda-6c93-417f-be59-a3c76be89e7e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:46:58.647566 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.648603 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:46:58.653861 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.654485 np0000002435 nova-compute[98325]: INFO os_vif [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') Jun 09 11:46:58.738600 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:58.829283 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 09 11:46:58.829283 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 09 11:46:58.829283 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 09 11:46:58.829283 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:58.829283 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 09 11:46:58.829283 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 09 11:46:58.829520 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 09 11:46:58.829520 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:58.829520 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 09 11:46:58.839380 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-plugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:58.839380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:58.839380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:58.839380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:58.839380 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Processing event network-vif-plugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:46:58.839600 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-plugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:58.839770 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:58.840061 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:58.840224 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:58.840443 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] No waiting events found dispatching network-vif-plugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:46:58.842111 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:46:58.844561 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received unexpected event network-vif-plugged-e5319a59-cd4b-4855-be1e-9107dd976810 for instance with vm_state building and task_state spawning. Jun 09 11:46:58.844760 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-plugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:58.845396 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:58.845396 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:58.845396 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:58.845562 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Processing event network-vif-plugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:46:58.845750 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-plugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:58.846092 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:46:58.846843 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:46:58.846843 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:58.846843 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:58.847009 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] No waiting events found dispatching network-vif-plugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:46:58.847615 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:46:58.847801 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ed1e72b2-4467-4a38-aaea-e9343447f6a5 req-9c1d3f98-c885-45d6-8d8f-fb33c77d7e08 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received unexpected event network-vif-plugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b for instance with vm_state building and task_state spawning. Jun 09 11:46:58.848816 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:46:58.850600 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:46:58.851440 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:46:58.851704 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] VM Started (Lifecycle Event) Jun 09 11:46:58.854132 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Instance spawned successfully. Jun 09 11:46:58.854612 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:46:58.855761 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Instance spawned successfully. Jun 09 11:46:58.856107 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:46:58.865447 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:58.865608 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:46:58.866155 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:46:58.909108 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.471s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:46:58.909569 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:46:58.914008 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.184s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:46:58.922318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:46:58.922525 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Claim successful on node np0000002435 Jun 09 11:46:58.964039 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:59.018909 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Received event network-changed-25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:46:59.019116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Refreshing instance network info cache due to event network-changed-25f56101-5739-4d62-b92f-5f16b88e86e0. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:46:59.024384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] Acquiring lock "refresh_cache-094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:46:59.157303 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updated VIF entry in instance network info cache for port dfc607e9-d1c6-474b-b876-d24787b0e300. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:46:59.157303 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:59.184279 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 09 11:46:59.184703 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 09 11:46:59.185233 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 09 11:46:59.185744 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:59.186078 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 09 11:46:59.186674 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 09 11:46:59.186674 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 09 11:46:59.186674 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: Jun 09 11:46:59.186674 np0000002435 nova-compute[98325]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 09 11:46:59.263912 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:59.270657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:59.272792 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:59.298529 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:59.305729 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:46:59.354255 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:46:59.356404 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:46:59.363197 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.363753 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.363951 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.364344 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.364665 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.364990 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.365309 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.365832 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.366049 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.366366 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.366649 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.370206 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:46:59.421250 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:46:59.426405 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:46:59.426987 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:59.426987 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:59.451906 np0000002435 sudo[110254]: pam_unix(sudo:session): session closed for user root Jun 09 11:46:59.454613 np0000002435 nova-compute[98325]: INFO oslo.privsep.daemon [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Spawned new privsep daemon via rootwrap Jun 09 11:46:59.465706 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:46:59.532584 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e0a2a4b6104128bfc54c2c9083fee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68e42f95c184ecab12e38e66deeb515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:46:59.580614 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:46:59.580614 np0000002435 nova-compute[98325]: WARNING os_brick.initiator.connectors.nvmeof [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 09 11:46:59.604136 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:46:59.623247 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:46:59.624730 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:46:59.636131 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:46:59.638307 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fe60:86b6', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010'] Jun 09 11:46:59.638307 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:46:59.638307 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:46:59.639931 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (1112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:46:59.640454 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Updating existing volume attachment record: f20b5fdb-fd4c-4540-bd28-be10eef860da {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:46:59.663051 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b6d7ab44-e6fa-4cc3-ae1d-b472202d2ccf req-2aff61ce-17bf-4bbd-9303-2c8384eb9778 service nova] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:46:59.666074 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:46:59.863788 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:46:59.864116 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:46:59.864218 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] VM Paused (Lifecycle Event) Jun 09 11:46:59.874955 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Took 10.38 seconds to spawn the instance on the hypervisor. Jun 09 11:46:59.875211 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:46:59.883303 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Took 8.12 seconds to spawn the instance on the hypervisor. Jun 09 11:46:59.883303 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:46:59.906979 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Updating instance_info_cache with network_info: [{"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:46:59.928939 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jun 09 11:47:00.080843 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.089722 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.110397 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.116974 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.172101 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:00.172221 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:00.172412 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No VIF found with MAC fa:16:3e:33:f9:9d, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:00.172764 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Using config drive Jun 09 11:47:00.228333 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.368125 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:00.373843 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:00.373979 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] VM Resumed (Lifecycle Event) Jun 09 11:47:00.386372 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Successfully created port: 0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:00.405994 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Took 15.77 seconds to build instance. Jun 09 11:47:00.411817 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:00.412116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Instance network_info: |[{"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:00.413649 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] Acquired lock "refresh_cache-094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:00.414769 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Refreshing network info cache for port 25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:00.419970 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:00.420162 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:00.428459 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Took 15.59 seconds to build instance. Jun 09 11:47:00.436064 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:00.554493 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.562509 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.565129 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.596793 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.603352 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:00.678067 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:00.851824 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Creating config drive at /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config Jun 09 11:47:00.855741 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp545p358u {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:00.877607 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:00.879567 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:00.883253 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp545p358u" returned: 0 in 0.027s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:00.909449 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-aa0f9def-c0a0-4756-a30a-b181378255b2 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.283s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:00.918766 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:00.924074 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:00.933941 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-500491be-74fe-4525-9bc0-8f4f3faa622a tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.100s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:01.285121 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:01.346584 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Successfully updated port: 0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:01.391687 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:01.391891 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] VM Resumed (Lifecycle Event) Jun 09 11:47:01.415701 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:01.439631 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.526s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:01.440320 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:01.449017 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:01.451310 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:01.453623 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:01.453724 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Creating image(s) Jun 09 11:47:01.454248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:01.454450 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "/opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:01.455114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "/opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:01.458598 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "2ef57df857c4ffde07460dc03679ce2a3d8e1df4" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:01.458928 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "2ef57df857c4ffde07460dc03679ce2a3d8e1df4" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:01.521688 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Updated VIF entry in instance network info cache for port 25f56101-5739-4d62-b92f-5f16b88e86e0. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:01.522035 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Updating instance_info_cache with network_info: [{"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:01.552231 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:01.598557 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-changed-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:01.598918 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Refreshing instance network info cache due to event network-changed-0c770421-8b9b-4ee3-959c-0f0a85cedc6b. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:01.598918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] Acquiring lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:01.599103 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] Acquired lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:01.599215 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Refreshing network info cache for port 0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:01.748595 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:01.748748 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:01.778801 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:01.779035 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:01.796662 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:01.797884 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:01.798159 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Creating image(s) Jun 09 11:47:01.800379 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:47:01.800379 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Ensure instance console log exists: /opt/stack/data/nova/instances/094562bc-f7ad-4b9a-a2cc-ca68d7b7c579/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:01.800379 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:01.800379 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:01.800379 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:01.800379 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Start _get_guest_xml network_info=[{"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '094562bc-f7ad-4b9a-a2cc-ca68d7b7c579', 'attached_at': '', 'detached_at': '', 'volume_id': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'serial': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'multiattach': True}, 'attachment_id': 'f20b5fdb-fd4c-4540-bd28-be10eef860da', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:01.805772 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:01.809562 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:01.809985 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:01.811389 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-688734038', uuid='094562bc-f7ad-4b9a-a2cc-ca68d7b7c579'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005621.8109012) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:01.815323 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:01.815323 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:01.816479 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:01.816663 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:01.817523 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:01.818602 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:01.818742 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:01.818836 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:01.818980 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:01.819719 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:01.819719 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:01.819719 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:01.821189 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:01.821678 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:01.821678 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:01.821809 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:01.828739 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:01.834858 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:01.835065 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:01.837936 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connector [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Factory for ISCSI on None {{(pid=98325) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 09 11:47:01.837936 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:01.837936 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:47:01.837936 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:01.837936 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:01.837936 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:01.839590 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:47:01.849044 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:01.855193 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:01.856494 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:01.856494 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:01.856597 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:01.856876 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:01.857059 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:01.868320 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:01.868320 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:01.873739 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:01.873739 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9] added Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:01.881822 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:01.882234 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:01.882298 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:01.882466 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9] added Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:01.886631 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:01.887295 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:01.887295 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:01.887295 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:01.895138 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:01.896801 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:01.958333 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:01.958799 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:01.959091 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:01.959341 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:02.025283 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-21c1af11-1073-4919-911f-4515d261c845 req-444a57f8-a897-45c5-be3f-685c59de9615 service nova] Releasing lock "refresh_cache-094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:02.049112 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '537da7f83e7a4deb8bc755cf2eedfd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c0b97f88c340218d8db8e1e6e13187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:02.107538 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:02.225321 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:02.250541 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:02.284025 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:02.400900 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:02.400900 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Started (Lifecycle Event) Jun 09 11:47:02.443886 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:02.446645 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:02.447199 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:02.462962 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:02.518069 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.part --force-share --output=json" returned: 0 in 0.071s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:02.519734 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] b097d1db-8ac6-47f3-8a86-f232bf287cf0 was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:47:02.520515 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:47:02.520684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.part /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:02.692176 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:02.699406 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.part /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.converted" returned: 0 in 0.179s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:02.707619 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:02.719209 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Successfully created port: df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:02.787167 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4.converted --force-share --output=json" returned: 0 in 0.079s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:02.789977 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "2ef57df857c4ffde07460dc03679ce2a3d8e1df4" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.331s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:02.792093 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:02.794936 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:02.803383 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:02.822324 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:02.822693 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:02.827960 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:02.829380 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Claim successful on node np0000002435 Jun 09 11:47:02.861736 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:02.880097 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4 --force-share --output=json" returned: 0 in 0.080s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:02.880901 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "2ef57df857c4ffde07460dc03679ce2a3d8e1df4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:02.881291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "2ef57df857c4ffde07460dc03679ce2a3d8e1df4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:02.883658 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:02.884658 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:02.891162 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:02.898894 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:02.900046 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:02.901870 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:02.903410 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:02.915405 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:02.917716 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:02.920040 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:02.923742 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:02.923742 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Paused (Lifecycle Event) Jun 09 11:47:02.930762 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:02.935771 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 09 11:47:02.935771 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:02.935771 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 09 11:47:02.935771 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:02.935771 np0000002435 nova-compute[98325]: WARNING os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 09 11:47:02.935771 np0000002435 nova-compute[98325]: Jun 09 11:47:02.943613 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 09 11:47:02.943613 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:02.943746 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 09 11:47:02.943746 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:02.944072 np0000002435 nova-compute[98325]: WARNING os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 09 11:47:02.944072 np0000002435 nova-compute[98325]: Jun 09 11:47:02.967725 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:02.974725 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4 --force-share --output=json" returned: 0 in 0.072s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:02.975126 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4,backing_fmt=raw /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:03.014487 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4,backing_fmt=raw /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk 1073741824" returned: 0 in 0.039s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:03.015981 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "2ef57df857c4ffde07460dc03679ce2a3d8e1df4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.135s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:03.016313 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:03.086223 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef57df857c4ffde07460dc03679ce2a3d8e1df4 --force-share --output=json" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:03.086628 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:03.086863 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:03.137914 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:03.138115 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:03.161317 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:03.161640 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Cannot resize image /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:03.161958 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:03.162115 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Ensure instance console log exists: /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:03.162382 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:03.162538 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:03.162695 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:03.199728 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] instance snapshotting Jun 09 11:47:03.238880 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Successfully updated port: df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:03.297360 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Beginning live snapshot process Jun 09 11:47:03.305648 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-changed-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:03.306252 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Refreshing instance network info cache due to event network-changed-df464bce-a7f9-41c4-9aa2-ce240dc07d47. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:03.306252 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] Acquiring lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:03.306252 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] Acquired lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:03.306252 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Refreshing network info cache for port df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:03.407608 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c544b06-6757-4770-b03d-adeb0268fc7a req-76532c0e-58fb-45ad-8ff5-bce5cc3eb6d4 service nova] Releasing lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:03.407975 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquired lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:03.408156 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:03.426628 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:03.429209 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:03.640435 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:03.650276 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:03.741199 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:03.811737 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:03.896617 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:03.932565 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:47:03.933067 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:03.934281 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Started (Lifecycle Event) Jun 09 11:47:03.972330 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9, portal: 192.168.50.100,3260] Jun 09 11:47:03.972330 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9, portal: 192.168.50.100,3260] successful. Jun 09 11:47:03.972330 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:03.972854 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9, portal: 192.168.40.100,3260] Jun 09 11:47:03.972854 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9, portal: 192.168.40.100,3260] successful. Jun 09 11:47:03.972854 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:03.980883 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:03.981818 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:03.982094 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Creating image(s) Jun 09 11:47:03.982540 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:03.982704 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "/opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:03.983162 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "/opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:03.983844 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:03.986844 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:03.987457 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:03.988046 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:03.988329 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.009104 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.009104 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.009104 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:04.009104 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.009104 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.009104 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:04.009569 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.153s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:04.009734 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:04.010664 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.010664 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.010664 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:04.010664 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.010664 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:04.010664 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:04.017079 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:04.019916 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.161s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:04.020626 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:04.024068 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:04.024068 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:04.027804 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:04.027969 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:04.038652 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: None {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:04.052342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:04.052592 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:04.066897 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.078s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.067162 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:04.070283 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:04.070283 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:04.072304 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:04.072676 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.137857 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:04.152506 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.080s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.157292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.193393 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk 1073741824" returned: 0 in 0.038s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.193998 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.126s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:04.194426 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.270796 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:04.308341 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.114s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.310506 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:04.312254 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:04.312542 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.384213 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.384559 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Cannot resize image /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:04.384838 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:04.385253 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Ensure instance console log exists: /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:04.385535 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:04.385717 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:04.385845 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:04.437220 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:04.441204 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:04.441360 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Paused (Lifecycle Event) Jun 09 11:47:04.469390 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Updating instance_info_cache with network_info: [{"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:04.533421 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:04.533595 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:04.640456 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a86b36b7-1d8a-4363-bb62-4fe5858d9b03 req-15ab5544-fbba-49c5-88e2-b879c124279e service nova] Releasing lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:04.640832 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquired lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:04.640981 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:04.811178 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json -f qcow2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.886350 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json -f qcow2" returned: 0 in 0.075s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.886846 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json -f qcow2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.945482 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:04.946189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json -f qcow2" returned: 0 in 0.059s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:04.946999 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:04.947953 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:04.951620 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:04.952173 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:04.972004 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Releasing lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:04.972526 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Instance network_info: |[{"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:04.975363 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Start _get_guest_xml network_info=[{"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:46:47Z,direct_url=,disk_format='qcow2',id=b097d1db-8ac6-47f3-8a86-f232bf287cf0,min_disk=0,min_ram=0,name='',owner='ca1fd4d021fc4ea0800cbf22cc37977e',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:46:49Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/sda', 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'image_id': 'b097d1db-8ac6-47f3-8a86-f232bf287cf0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:04.979107 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:04.980863 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b097d1db-8ac6-47f3-8a86-f232bf287cf0', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1913696064', uuid='f9e4069d-81e1-4c41-9f3b-3e0ea9756c05'), owner=OwnerMeta(userid='e8e0a2a4b6104128bfc54c2c9083fee2', username='tempest-AttachSCSIVolumeTestJSON-164304252-project-member', projectid='a68e42f95c184ecab12e38e66deeb515', projectname='tempest-AttachSCSIVolumeTestJSON-164304252'), image=ImageMeta(id='b097d1db-8ac6-47f3-8a86-f232bf287cf0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005624.980438) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:04.981624 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:04.982060 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:04.982696 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:04.982918 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:04.984312 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:04.984738 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:46:47Z,direct_url=,disk_format='qcow2',id=b097d1db-8ac6-47f3-8a86-f232bf287cf0,min_disk=0,min_ram=0,name='',owner='ca1fd4d021fc4ea0800cbf22cc37977e',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:46:49Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:04.984920 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:04.985155 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:04.985345 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:04.985470 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:04.985590 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:04.985797 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:04.985931 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:04.986097 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:04.986236 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:04.986428 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:05.004398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1913696064',display_name='tempest-AttachSCSIVolumeTestJSON-server-1913696064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachscsivolumetestjson-server-1913696064',id=6,image_ref='b097d1db-8ac6-47f3-8a86-f232bf287cf0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4gG+NC8hGGUk04qbFEgxxvKkgUp0/BL5Xrx9Rh/c+qYEP8AxWzRGA6yV5vmHlgNONftQfrDold+cK6Hbd3neq50qSHWpGnjCOVv17RGhjaVKeWFpJ6vapaKOPHmnx4CQ==',key_name='tempest-keypair-900619453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a68e42f95c184ecab12e38e66deeb515',ramdisk_id='',reservation_id='r-2x8i7vlm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b097d1db-8ac6-47f3-8a86-f232bf287cf0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-164304252',owner_user_name='tempest-AttachSCSIVolumeTestJSON-164304252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e0a2a4b6104128bfc54c2c9083fee2',uuid=f9e4069d-81e1-4c41-9f3b-3e0ea9756c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:05.004611 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Converting VIF {"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:05.005499 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:05.006184 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lazy-loading 'pci_devices' on Instance uuid f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:05.016694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.064s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:05.018448 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5ay69648/15252697fbbd45f98efad81ba7e62cb0.delta 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:05.039423 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:05.045638 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:05.045893 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:05.052854 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5ay69648/15252697fbbd45f98efad81ba7e62cb0.delta 1073741824" returned: 0 in 0.034s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:05.053454 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Quiescing instance not available: QEMU guest agent is not enabled. Jun 09 11:47:05.198923 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:05.235919 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.294294 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 09 11:47:05.294294 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 09 11:47:05.336899 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:47:05.337144 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5ay69648/15252697fbbd45f98efad81ba7e62cb0.delta /opt/stack/data/nova/instances/snapshots/tmp5ay69648/15252697fbbd45f98efad81ba7e62cb0 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:05.369032 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:05.412492 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5ay69648/15252697fbbd45f98efad81ba7e62cb0.delta /opt/stack/data/nova/instances/snapshots/tmp5ay69648/15252697fbbd45f98efad81ba7e62cb0" returned: 0 in 0.075s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:05.412955 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Snapshot extracted, beginning image upload Jun 09 11:47:05.455001 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] End _get_guest_xml xml= Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: instance-00000006 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: tempest-AttachSCSIVolumeTestJSON-server-1913696064 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 2026-06-09 11:47:04 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: True Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: bare Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: scsi Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: scsi Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: virtio-scsi Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: tempest-AttachSCSIVolumeTestJSON-164304252-project-member Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: tempest-AttachSCSIVolumeTestJSON-164304252 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]:
Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]:
Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: Jun 09 11:47:05.509953 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:05.512191 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Preparing to wait for external event network-vif-plugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:05.512191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:05.512191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:05.512191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:05.512191 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1913696064',display_name='tempest-AttachSCSIVolumeTestJSON-server-1913696064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachscsivolumetestjson-server-1913696064',id=6,image_ref='b097d1db-8ac6-47f3-8a86-f232bf287cf0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4gG+NC8hGGUk04qbFEgxxvKkgUp0/BL5Xrx9Rh/c+qYEP8AxWzRGA6yV5vmHlgNONftQfrDold+cK6Hbd3neq50qSHWpGnjCOVv17RGhjaVKeWFpJ6vapaKOPHmnx4CQ==',key_name='tempest-keypair-900619453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a68e42f95c184ecab12e38e66deeb515',ramdisk_id='',reservation_id='r-2x8i7vlm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b097d1db-8ac6-47f3-8a86-f232bf287cf0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-164304252',owner_user_name='tempest-AttachSCSIVolumeTestJSON-164304252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e0a2a4b6104128bfc54c2c9083fee2',uuid=f9e4069d-81e1-4c41-9f3b-3e0ea9756c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:05.512508 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Converting VIF {"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:05.512802 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:05.513069 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:05.513547 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.513934 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:05.514272 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:05.515033 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.515228 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '061a8389-7b51-5ca7-b891-c6400411cad1', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:05.516063 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.516756 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:05.517842 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.519731 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.519913 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c770421-8b, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:05.520270 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c770421-8b, col_values=(('qos', UUID('397ccbbd-0c6b-4dae-a71d-5e5f38bfe470')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:05.520435 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c770421-8b, col_values=(('external_ids', {'iface-id': '0c770421-8b9b-4ee3-959c-0f0a85cedc6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:e1:ea', 'vm-uuid': 'f9e4069d-81e1-4c41-9f3b-3e0ea9756c05'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:05.521114 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.522147 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:05.527723 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:05.529462 np0000002435 nova-compute[98325]: INFO os_vif [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') Jun 09 11:47:05.545920 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Updating instance_info_cache with network_info: [{"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:05.548834 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.726s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:05.550907 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.688s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:05.551101 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:05.556096 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:05.556272 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Claim successful on node np0000002435 Jun 09 11:47:05.878779 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000bec106a7 for multipath device dm-0 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:47:05.879182 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.041s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:05.882480 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (4041ms) {'type': 'block', 'scsi_wwn': '330000000bec106a7', 'path': '/dev/dm-0', 'multipath_id': '330000000bec106a7'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:05.882640 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bec106a7', 'path': '/dev/dm-0', 'multipath_id': '330000000bec106a7'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:47:06.051492 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Releasing lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:06.051492 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Instance network_info: |[{"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:06.052489 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Start _get_guest_xml network_info=[{"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:06.054274 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:06.055275 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-210691191', uuid='3c6c08b5-e35f-48de-8928-810d426a8122'), owner=OwnerMeta(userid='537da7f83e7a4deb8bc755cf2eedfd26', username='tempest-VolumesAssistedSnapshotsTest-1055922968-project-member', projectid='94c0b97f88c340218d8db8e1e6e13187', projectname='tempest-VolumesAssistedSnapshotsTest-1055922968'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005626.0549843) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:06.056075 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:06.056439 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:06.057221 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:06.057400 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:06.058230 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:06.058515 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:06.058640 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:06.058737 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:06.058894 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:06.061895 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:06.062047 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:06.062255 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:06.067752 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:06.068444 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:06.068905 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:06.069001 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:06.069118 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:06.072282 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:06.078319 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:06.078668 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:06.084748 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-210691191',display_name='tempest-VolumesAssistedSnapshotsTest-server-210691191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesassistedsnapshotstest-server-210691191',id=7,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtfXaPovHIEtRHyYj6BuTxTNB0g/qRqujIuEvzb3Mdh3HKJNugcCOl0eBKL3Oo+BZN6pfsRVtCXong1PHH8m4Xqji1am8wIjYlKqJdu/1eYhUL8WxIq1lLBChNC3NInzA==',key_name='tempest-keypair-979541135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c0b97f88c340218d8db8e1e6e13187',ramdisk_id='',reservation_id='r-z7l00w4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1055922968',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1055922968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='537da7f83e7a4deb8bc755cf2eedfd26',uuid=3c6c08b5-e35f-48de-8928-810d426a8122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:06.084871 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Converting VIF {"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:06.085351 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:06.085846 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:06.146346 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e744c937528439ca06004bbeaae0f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94910fada777407994d5908d5c1de121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:06.387941 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-688734038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachvolumemultiattachtest-server-688734038',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-oi1xt4ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:58Z,user_data=None,user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=094562bc-f7ad-4b9a-a2cc-ca68d7b7c579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:06.388205 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:06.388695 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=25f56101-5739-4d62-b92f-5f16b88e86e0,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f56101-57') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:06.389224 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'pci_devices' on Instance uuid 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:06.571833 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] End _get_guest_xml xml= Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 3c6c08b5-e35f-48de-8928-810d426a8122 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: instance-00000007 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: tempest-VolumesAssistedSnapshotsTest-server-210691191 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 2026-06-09 11:47:06 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: True Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: bare Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: tempest-VolumesAssistedSnapshotsTest-1055922968-project-member Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: tempest-VolumesAssistedSnapshotsTest-1055922968 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 3c6c08b5-e35f-48de-8928-810d426a8122 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 3c6c08b5-e35f-48de-8928-810d426a8122 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: Jun 09 11:47:06.591501 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:06.593625 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Preparing to wait for external event network-vif-plugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:06.593625 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:06.593625 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:06.593625 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:06.593625 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-210691191',display_name='tempest-VolumesAssistedSnapshotsTest-server-210691191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesassistedsnapshotstest-server-210691191',id=7,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtfXaPovHIEtRHyYj6BuTxTNB0g/qRqujIuEvzb3Mdh3HKJNugcCOl0eBKL3Oo+BZN6pfsRVtCXong1PHH8m4Xqji1am8wIjYlKqJdu/1eYhUL8WxIq1lLBChNC3NInzA==',key_name='tempest-keypair-979541135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94c0b97f88c340218d8db8e1e6e13187',ramdisk_id='',reservation_id='r-z7l00w4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1055922968',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1055922968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='537da7f83e7a4deb8bc755cf2eedfd26',uuid=3c6c08b5-e35f-48de-8928-810d426a8122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:06.593878 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Converting VIF {"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:06.594474 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:06.594876 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:06.595212 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.595463 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.595657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:06.596459 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.596635 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9112bd75-90cc-5f8b-9b88-1636a10830d5', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.597331 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.599060 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:06.604835 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.607913 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.608128 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf464bce-a7, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.608493 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf464bce-a7, col_values=(('qos', UUID('fdb11503-41ec-4869-a498-eeaae1b30f09')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.608651 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf464bce-a7, col_values=(('external_ids', {'iface-id': 'df464bce-a7f9-41c4-9aa2-ce240dc07d47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5a:a0', 'vm-uuid': '3c6c08b5-e35f-48de-8928-810d426a8122'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.609566 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.612230 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:06.627712 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.629161 np0000002435 nova-compute[98325]: INFO os_vif [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') Jun 09 11:47:06.630827 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Successfully created port: e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] End _get_guest_xml xml= Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: instance-00000005 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-server-688734038 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 2026-06-09 11:47:01 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: True Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: 37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: Jun 09 11:47:06.892730 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:06.894978 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Preparing to wait for external event network-vif-plugged-25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:06.894978 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:06.894978 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:06.894978 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:06.894978 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-688734038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachvolumemultiattachtest-server-688734038',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-oi1xt4ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:46:58Z,user_data=None,user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=094562bc-f7ad-4b9a-a2cc-ca68d7b7c579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:06.895194 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "25f56101-5739-4d62-b92f-5f16b88e86e0", "address": "fa:16:3e:8a:c0:6e", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f56101-57", "ovs_interfaceid": "25f56101-5739-4d62-b92f-5f16b88e86e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:06.895194 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=25f56101-5739-4d62-b92f-5f16b88e86e0,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f56101-57') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:06.895194 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=25f56101-5739-4d62-b92f-5f16b88e86e0,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f56101-57') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:06.895194 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.895346 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.896239 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:06.896239 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.896833 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35fa44f5-de8e-5c01-9a71-f439f36825b8', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.898489 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:06.910891 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.918478 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.918691 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25f56101-57, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.920292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25f56101-57, col_values=(('qos', UUID('184e74da-53f8-4307-abcd-ce80e3d43f77')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.920292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25f56101-57, col_values=(('external_ids', {'iface-id': '25f56101-5739-4d62-b92f-5f16b88e86e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:c0:6e', 'vm-uuid': '094562bc-f7ad-4b9a-a2cc-ca68d7b7c579'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:06.923279 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.923279 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:06.939130 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:06.939859 np0000002435 nova-compute[98325]: INFO os_vif [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=25f56101-5739-4d62-b92f-5f16b88e86e0,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f56101-57') Jun 09 11:47:07.049099 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No BDM found with device name sda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:07.049156 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:07.049228 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No VIF found with MAC fa:16:3e:2d:e1:ea, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:07.049638 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Using config drive Jun 09 11:47:07.074489 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:07.135622 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:07.135864 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:07.189579 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Successfully updated port: e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:07.349909 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-changed-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:07.350100 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Refreshing instance network info cache due to event network-changed-e8a74c52-55ef-4f12-811a-9909791cf2be. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:07.350250 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] Acquiring lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] Acquired lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Refreshing network info cache for port e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Creating config drive at /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk.config Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptk9u0u7k {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:07.777751 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptk9u0u7k" returned: 0 in 0.029s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:07.855383 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:07.953658 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:08.083203 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:08.084350 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:08.084848 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Creating image(s) Jun 09 11:47:08.085174 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "/opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:08.085386 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "/opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:08.085871 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "/opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:08.086422 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:08.088988 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:08.090369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:08.153661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.604s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:08.155430 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:08.161282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.891s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:08.172696 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:08.173079 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Claim successful on node np0000002435 Jun 09 11:47:08.184239 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:08.184461 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:08.184615 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] No VIF found with MAC fa:16:3e:78:5a:a0, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:08.188036 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.094s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:08.188369 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Using config drive Jun 09 11:47:08.190087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:08.190087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:08.190414 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:08.193174 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:08.197096 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:08.212750 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.231113 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.235321 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:08.284026 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.087s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:08.285433 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:08.346144 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk 1073741824" returned: 0 in 0.060s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:08.347092 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.157s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:08.347298 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:08.370707 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.447236 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.100s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:08.447626 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:08.448381 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:08.469129 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:08.469254 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:08.469700 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:8a:c0:6e, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:08.469930 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Using config drive Jun 09 11:47:08.543603 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:08.544541 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Cannot resize image /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:08.544907 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:08.545340 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Ensure instance console log exists: /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:08.546147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:08.546386 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:08.546524 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:08.603119 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5fc4d0cd-7c99-4b85-ba41-6ff22dcb205e req-1204f00c-4ebc-4e17-8ece-e1e83acc80f2 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-vif-plugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:08.604536 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5fc4d0cd-7c99-4b85-ba41-6ff22dcb205e req-1204f00c-4ebc-4e17-8ece-e1e83acc80f2 service nova] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:08.605143 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5fc4d0cd-7c99-4b85-ba41-6ff22dcb205e req-1204f00c-4ebc-4e17-8ece-e1e83acc80f2 service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:08.605363 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5fc4d0cd-7c99-4b85-ba41-6ff22dcb205e req-1204f00c-4ebc-4e17-8ece-e1e83acc80f2 service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:08.608398 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5fc4d0cd-7c99-4b85-ba41-6ff22dcb205e req-1204f00c-4ebc-4e17-8ece-e1e83acc80f2 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Processing event network-vif-plugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:08.645227 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.657288 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.660201 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.672705 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:08.672818 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:08.675531 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:08.675531 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:08.690289 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.706026 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:08.707685 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:08.743661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a9c01c23-af3d-401b-af59-18b528d2bba4 req-b5c69e82-5bfe-49a3-a05c-8b45c0643b25 service nova] Releasing lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:08.746745 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquired lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:08.746966 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:08.770328 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Snapshot image upload complete Jun 09 11:47:08.770637 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-219b93ea-d8e3-4e6b-8ac2-0d5cf90bc6cb tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Took 5.57 seconds to snapshot the instance on the hypervisor. Jun 09 11:47:08.800253 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e744c937528439ca06004bbeaae0f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94910fada777407994d5908d5c1de121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:08.929512 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Creating config drive at /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk.config Jun 09 11:47:08.936240 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptow1rxg_ {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:08.974116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptow1rxg_" returned: 0 in 0.038s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:08.979784 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:09.156015 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Creating config drive at /opt/stack/data/nova/instances/094562bc-f7ad-4b9a-a2cc-ca68d7b7c579/disk.config Jun 09 11:47:09.160712 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/094562bc-f7ad-4b9a-a2cc-ca68d7b7c579/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3hg23si2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:09.175055 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:09.196500 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/094562bc-f7ad-4b9a-a2cc-ca68d7b7c579/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3hg23si2" returned: 0 in 0.036s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:09.272061 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:09.273257 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:09.273401 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] VM Started (Lifecycle Event) Jun 09 11:47:09.278916 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:09.281254 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Instance spawned successfully. Jun 09 11:47:09.281919 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:09.284492 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:09.284842 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:09.285186 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:09.285529 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:09.354523 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:09.442604 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0ceb39ec-c116-4325-9ec5-b4661d666da4 req-175d7bb2-76a6-4428-97a1-e9cfbc74dc6a service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:09.442903 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0ceb39ec-c116-4325-9ec5-b4661d666da4 req-175d7bb2-76a6-4428-97a1-e9cfbc74dc6a service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:09.443240 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0ceb39ec-c116-4325-9ec5-b4661d666da4 req-175d7bb2-76a6-4428-97a1-e9cfbc74dc6a service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:09.443240 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0ceb39ec-c116-4325-9ec5-b4661d666da4 req-175d7bb2-76a6-4428-97a1-e9cfbc74dc6a service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:09.443986 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0ceb39ec-c116-4325-9ec5-b4661d666da4 req-175d7bb2-76a6-4428-97a1-e9cfbc74dc6a service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No event matching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc in dict_keys([('network-vif-plugged', '0e7cee76-43d3-41de-96b9-771f91b176fc')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:47:09.443986 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-0ceb39ec-c116-4325-9ec5-b4661d666da4 req-175d7bb2-76a6-4428-97a1-e9cfbc74dc6a service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state building and task_state spawning. Jun 09 11:47:09.615733 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:09.691364 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Successfully created port: 49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:09.696821 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:09.781159 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:09.793362 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:09.799619 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Took 8.35 seconds to spawn the instance on the hypervisor. Jun 09 11:47:09.802428 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:09.878234 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Updating instance_info_cache with network_info: [{"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:09.928549 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:09.956227 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:09.958114 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:09.958685 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:10.074130 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.101785 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.101785 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.205955 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.240895 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.304852 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:47:10.304852 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:10.304852 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] VM Paused (Lifecycle Event) Jun 09 11:47:10.319089 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.322424 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Took 17.20 seconds to build instance. Jun 09 11:47:10.329990 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.336469 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.355946 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.388143 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Releasing lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:10.389531 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Instance network_info: |[{"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:10.390780 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Start _get_guest_xml network_info=[{"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:10.395213 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:10.396798 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1955933568-1', uuid='909cacb1-a84f-45bf-b343-ab2e830208c7'), owner=OwnerMeta(userid='2e744c937528439ca06004bbeaae0f21', username='tempest-TestMultiAttachVolumeSwap-911853440-project-member', projectid='94910fada777407994d5908d5c1de121', projectname='tempest-TestMultiAttachVolumeSwap-911853440'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005630.396349) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:10.408129 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:10.408129 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:10.413687 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:10.413687 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:10.413843 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:10.414229 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:10.414467 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:10.422173 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:10.424572 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:10.424572 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:10.424572 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:10.424572 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:10.426313 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:10.427640 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:10.427640 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:10.427640 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:10.442647 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1955933568-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testmultiattachvolumeswap-server-1955933568-1',id=8,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dHRkrhueaMQcxoJlDVMI97zTM0STm8k3OWEtoeKN3KbBwc9/o+wr2GIbG5MVCsdammXnulk/XaaRIyJTtvifHA6CyZoJz3M9D4y7MvyQ/zbJETqL46zOh7ZAIKi6SiA==',key_name='tempest-keypair-1618552104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94910fada777407994d5908d5c1de121',ramdisk_id='',reservation_id='r-o06cnakl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-911853440',owner_user_name='tempest-TestMultiAttachVolumeSwap-911853440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e744c937528439ca06004bbeaae0f21',uuid=909cacb1-a84f-45bf-b343-ab2e830208c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:10.442856 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converting VIF {"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:10.443429 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:10.443698 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'pci_devices' on Instance uuid 909cacb1-a84f-45bf-b343-ab2e830208c7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:10.462078 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:10.475251 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Successfully updated port: 49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:10.670190 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-changed-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:10.670190 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Refreshing instance network info cache due to event network-changed-49bd34b5-99d7-4615-9653-01ff6a59c4cf. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:10.670190 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] Acquiring lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:10.670190 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] Acquired lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:10.670190 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Refreshing network info cache for port 49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:10.707109 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-vif-plugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:10.707306 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:10.707509 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:10.708469 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.711376 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] No waiting events found dispatching network-vif-plugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:10.711376 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:10.711376 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received unexpected event network-vif-plugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b for instance with vm_state active and task_state None. Jun 09 11:47:10.711376 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-plugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:10.711552 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:10.711800 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:10.712448 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:10.715031 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.715031 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-83fc4654-baf6-4ebe-9d52-dfd5322f0a77 req-aaec0856-aa4d-416e-b425-58b757533e6a service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Processing event network-vif-plugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:10.715031 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Creating image(s) Jun 09 11:47:10.715031 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "/opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:10.715031 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "/opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:10.715427 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "/opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.716029 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:10.721708 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:10.722999 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:10.811063 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:10.813436 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:10.813436 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] VM Resumed (Lifecycle Event) Jun 09 11:47:10.819604 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:10.821733 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:10.822139 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:10.822820 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:10.825479 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:10.829529 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-fd61617c-aeeb-4593-b459-e4876305bde2 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.715s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.829529 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:10.890410 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:10.890951 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:10.897882 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.921992 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:10.925281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:10.935338 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] End _get_guest_xml xml= Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 909cacb1-a84f-45bf-b343-ab2e830208c7 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: instance-00000008 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: tempest-TestMultiAttachVolumeSwap-server-1955933568-1 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 2026-06-09 11:47:10 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: True Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: bare Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: tempest-TestMultiAttachVolumeSwap-911853440-project-member Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: tempest-TestMultiAttachVolumeSwap-911853440 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 909cacb1-a84f-45bf-b343-ab2e830208c7 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 909cacb1-a84f-45bf-b343-ab2e830208c7 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: Jun 09 11:47:10.949831 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:10.952633 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Preparing to wait for external event network-vif-plugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:10.952633 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:10.952633 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:10.952633 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.952633 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1955933568-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testmultiattachvolumeswap-server-1955933568-1',id=8,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dHRkrhueaMQcxoJlDVMI97zTM0STm8k3OWEtoeKN3KbBwc9/o+wr2GIbG5MVCsdammXnulk/XaaRIyJTtvifHA6CyZoJz3M9D4y7MvyQ/zbJETqL46zOh7ZAIKi6SiA==',key_name='tempest-keypair-1618552104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94910fada777407994d5908d5c1de121',ramdisk_id='',reservation_id='r-o06cnakl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-911853440',owner_user_name='tempest-TestMultiAttachVolumeSwap-911853440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e744c937528439ca06004bbeaae0f21',uuid=909cacb1-a84f-45bf-b343-ab2e830208c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:10.952937 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converting VIF {"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:10.952937 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:10.952937 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:10.953124 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.953389 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:10.953681 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:10.955409 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.955680 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15e0c885-bcde-57f0-b8c0-a3832752f005', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:10.956414 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.957035 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:10.958890 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.966729 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.967111 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a74c52-55, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:10.967832 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8a74c52-55, col_values=(('qos', UUID('7786ad91-e89e-458b-b766-29463d7dd685')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:10.968138 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8a74c52-55, col_values=(('external_ids', {'iface-id': 'e8a74c52-55ef-4f12-811a-9909791cf2be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:eb:33', 'vm-uuid': '909cacb1-a84f-45bf-b343-ab2e830208c7'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:10.969287 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk 1073741824" returned: 0 in 0.047s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:10.969441 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.969865 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.148s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.971960 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:10.973159 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:10.988714 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:10.993486 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.832s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:10.998095 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:10.998550 np0000002435 nova-compute[98325]: INFO os_vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') Jun 09 11:47:10.999165 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:11.075501 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.102s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:11.075938 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:11.076244 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:11.163068 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:11.163644 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:11.164099 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Cannot resize image /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:11.164575 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:11.164831 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Ensure instance console log exists: /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:11.165195 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:11.165495 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:11.165627 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:11.168088 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:11.170792 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Instance spawned successfully. Jun 09 11:47:11.171156 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:11.173807 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:11.241424 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:11.321757 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:11.325970 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:11.395989 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:11.423119 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:11.503772 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:11.504150 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:11.504486 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:11.509476 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:11.512800 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:11.512800 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:11.512800 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:11.513216 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Processing event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state building and task_state spawning. Jun 09 11:47:11.514581 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:11.516254 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:11.516254 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:11.516254 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:11.516254 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] No event matching network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be in dict_keys([('network-vif-plugged', 'e8a74c52-55ef-4f12-811a-9909791cf2be')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:47:11.516254 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ff187ae4-25c4-4752-a93e-cbd5591842e3 req-2c78f4ba-97f0-462a-bf30-89b06414a0bf service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received unexpected event network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be for instance with vm_state building and task_state spawning. Jun 09 11:47:11.516254 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:11.521779 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:11.528717 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance spawned successfully. Jun 09 11:47:11.531653 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:11.600236 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5ac4f1fac1e4dfbbc2e97d1aaa39971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ec66aa0aa54ed1b5f0ca42b1f529a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:11.679944 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:11.680090 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:11.680347 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:11.680623 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:11.680888 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:11.681202 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:11.829596 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:11.829596 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] VM Started (Lifecycle Event) Jun 09 11:47:11.928736 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-71a9afcb-37d6-4ae8-a44e-370fca343b9b req-d382f31e-45e6-45d3-a76d-f99c5947ff78 service nova] Releasing lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:11.929279 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquired lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:11.929480 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:11.969839 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:11.970138 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:11.973709 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:11.973859 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Claim successful on node np0000002435 Jun 09 11:47:12.012454 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:12.045184 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:12.045394 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:12.045903 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:12.046328 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:12.047650 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:12.047650 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:12.138720 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Successfully created port: 5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:12.186045 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Took 8.20 seconds to spawn the instance on the hypervisor. Jun 09 11:47:12.186188 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:12.333480 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:12.334873 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:12.491392 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:12.515534 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:12.543322 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:12.543477 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:12.543612 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No VIF found with MAC fa:16:3e:89:eb:33, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:12.544124 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Using config drive Jun 09 11:47:12.556453 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Took 18.43 seconds to spawn the instance on the hypervisor. Jun 09 11:47:12.556671 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:12.679365 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:12.697643 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Took 18.02 seconds to build instance. Jun 09 11:47:12.793756 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-plugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:12.793953 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:12.794125 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:12.794255 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:12.794424 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] No waiting events found dispatching network-vif-plugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:12.794594 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received unexpected event network-vif-plugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 for instance with vm_state active and task_state None. Jun 09 11:47:12.794750 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Received event network-vif-plugged-25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:12.794910 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Acquiring lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:12.795119 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:12.795280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:12.795434 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Processing event network-vif-plugged-25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:12.795619 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Received event network-vif-plugged-25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:12.795855 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Acquiring lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:12.796902 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:12.798614 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:12.799319 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Successfully updated port: 5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:12.804872 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:12.805392 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:12.805553 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] No waiting events found dispatching network-vif-plugged-25f56101-5739-4d62-b92f-5f16b88e86e0 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:12.805720 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Received unexpected event network-vif-plugged-25f56101-5739-4d62-b92f-5f16b88e86e0 for instance with vm_state building and task_state spawning. Jun 09 11:47:12.805866 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-changed-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:12.806024 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Refreshing instance network info cache due to event network-changed-0c770421-8b9b-4ee3-959c-0f0a85cedc6b. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:12.806211 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Acquiring lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:12.806362 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Acquired lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:12.806508 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Refreshing network info cache for port 0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:12.809651 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Instance spawned successfully. Jun 09 11:47:12.810612 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:12.837300 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:12.837439 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] VM Paused (Lifecycle Event) Jun 09 11:47:12.851364 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updating instance_info_cache with network_info: [{"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:13.065102 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:13.076239 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Took 26.50 seconds to build instance. Jun 09 11:47:13.200623 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-845d9f22-c8d7-44a7-a242-305a3ee699cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.536s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:13.257425 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Creating config drive at /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk.config Jun 09 11:47:13.266823 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl342niun {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:13.306963 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "refresh_cache-9e09fd87-2029-4130-9679-3c73b357cfd7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:13.306963 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquired lock "refresh_cache-9e09fd87-2029-4130-9679-3c73b357cfd7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:13.306963 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:13.310105 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:13.312011 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl342niun" returned: 0 in 0.045s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:13.323293 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:13.323293 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:13.323293 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:13.323913 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:13.325834 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:13.325834 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:13.339631 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:13.355344 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Releasing lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:13.355344 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Instance network_info: |[{"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:13.355344 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:13.355344 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] VM Resumed (Lifecycle Event) Jun 09 11:47:13.359485 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Start _get_guest_xml network_info=[{"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:13.389727 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:13.391497 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1955933568-2', uuid='20e2f567-45b9-4beb-b58c-6e62b337525d'), owner=OwnerMeta(userid='2e744c937528439ca06004bbeaae0f21', username='tempest-TestMultiAttachVolumeSwap-911853440-project-member', projectid='94910fada777407994d5908d5c1de121', projectname='tempest-TestMultiAttachVolumeSwap-911853440'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005633.3910468) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:13.400209 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:13.400925 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:13.410789 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:13.412355 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:13.412355 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:13.412355 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:13.412702 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:13.412837 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:13.412924 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:13.413007 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:13.413111 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:13.413281 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:13.414965 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:13.414965 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:13.414965 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:13.414965 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:13.452395 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1955933568-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testmultiattachvolumeswap-server-1955933568-2',id=9,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dHRkrhueaMQcxoJlDVMI97zTM0STm8k3OWEtoeKN3KbBwc9/o+wr2GIbG5MVCsdammXnulk/XaaRIyJTtvifHA6CyZoJz3M9D4y7MvyQ/zbJETqL46zOh7ZAIKi6SiA==',key_name='tempest-keypair-1618552104',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94910fada777407994d5908d5c1de121',ramdisk_id='',reservation_id='r-o06cnakl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-911853440',owner_user_name='tempest-TestMultiAttachVolumeSwap-911853440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e744c937528439ca06004bbeaae0f21',uuid=20e2f567-45b9-4beb-b58c-6e62b337525d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:13.452636 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converting VIF {"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:13.453381 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:13.456285 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'pci_devices' on Instance uuid 20e2f567-45b9-4beb-b58c-6e62b337525d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:13.530377 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:13.532312 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:13.532595 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Creating image(s) Jun 09 11:47:13.533146 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:13.533445 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "/opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:13.534061 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "/opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:13.534770 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:13.542662 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:13.546900 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:13.584294 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-396cd19b-f96b-4d07-9cf4-423c917d7972 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.016s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:13.645482 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:13.645482 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:13.646088 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:13.646613 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:13.649587 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:13.650012 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:13.685522 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-changed-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:13.685654 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Refreshing instance network info cache due to event network-changed-5305a225-7233-4cb2-a00c-70e3cd22fadd. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:13.685892 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] Acquiring lock "refresh_cache-9e09fd87-2029-4130-9679-3c73b357cfd7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:13.760285 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:13.760777 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:13.801314 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk 1073741824" returned: 0 in 0.040s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:13.801922 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.156s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:13.802522 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:13.837208 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Took 12.04 seconds to spawn the instance on the hypervisor. Jun 09 11:47:13.837744 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:13.866189 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:13.875333 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:13.911552 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:13.912562 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:13.912562 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] End _get_guest_xml xml= Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 20e2f567-45b9-4beb-b58c-6e62b337525d Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: instance-00000009 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: tempest-TestMultiAttachVolumeSwap-server-1955933568-2 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 2026-06-09 11:47:13 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: True Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: bare Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: tempest-TestMultiAttachVolumeSwap-911853440-project-member Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: tempest-TestMultiAttachVolumeSwap-911853440 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 20e2f567-45b9-4beb-b58c-6e62b337525d Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 20e2f567-45b9-4beb-b58c-6e62b337525d Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: Jun 09 11:47:13.960951 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:13.963361 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Preparing to wait for external event network-vif-plugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:13.963361 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:13.963361 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:13.963361 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:13.966493 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1955933568-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testmultiattachvolumeswap-server-1955933568-2',id=9,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dHRkrhueaMQcxoJlDVMI97zTM0STm8k3OWEtoeKN3KbBwc9/o+wr2GIbG5MVCsdammXnulk/XaaRIyJTtvifHA6CyZoJz3M9D4y7MvyQ/zbJETqL46zOh7ZAIKi6SiA==',key_name='tempest-keypair-1618552104',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94910fada777407994d5908d5c1de121',ramdisk_id='',reservation_id='r-o06cnakl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-911853440',owner_user_name='tempest-TestMultiAttachVolumeSwap-911853440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e744c937528439ca06004bbeaae0f21',uuid=20e2f567-45b9-4beb-b58c-6e62b337525d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:13.966493 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converting VIF {"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:13.966772 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:13.967303 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:13.969609 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:13.969609 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:13.969950 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:13.971330 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:13.971543 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd429d54-0830-583e-86ad-943fad64a374', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:13.972454 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:13.973434 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:13.988085 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.007292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.007292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49bd34b5-99, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:14.007292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49bd34b5-99, col_values=(('qos', UUID('4e2d7cfe-3e80-4845-944a-88190a452d9f')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:14.007292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49bd34b5-99, col_values=(('external_ids', {'iface-id': '49bd34b5-99d7-4615-9653-01ff6a59c4cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:5b:bd', 'vm-uuid': '20e2f567-45b9-4beb-b58c-6e62b337525d'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:14.008359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:14.008685 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Cannot resize image /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:14.008995 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:14.011114 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Ensure instance console log exists: /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:14.011114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:14.011114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:14.011114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:14.012009 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.018514 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:14.029758 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.042498 np0000002435 nova-compute[98325]: INFO os_vif [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') Jun 09 11:47:14.110290 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:14.110290 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:14.124176 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:14.142729 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.162662 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:14.349151 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f20b0cdc-88a6-4549-a24e-be4c9a502dbf req-92b3cb54-7e78-4849-9f7c-798452b7da89 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:14.351103 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f20b0cdc-88a6-4549-a24e-be4c9a502dbf req-92b3cb54-7e78-4849-9f7c-798452b7da89 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:14.351103 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f20b0cdc-88a6-4549-a24e-be4c9a502dbf req-92b3cb54-7e78-4849-9f7c-798452b7da89 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:14.351103 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f20b0cdc-88a6-4549-a24e-be4c9a502dbf req-92b3cb54-7e78-4849-9f7c-798452b7da89 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:14.351103 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f20b0cdc-88a6-4549-a24e-be4c9a502dbf req-92b3cb54-7e78-4849-9f7c-798452b7da89 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No event matching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 in dict_keys([('network-vif-plugged', 'dfc607e9-d1c6-474b-b876-d24787b0e300')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:47:14.351103 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-f20b0cdc-88a6-4549-a24e-be4c9a502dbf req-92b3cb54-7e78-4849-9f7c-798452b7da89 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state building and task_state spawning. Jun 09 11:47:14.372760 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Took 24.21 seconds to build instance. Jun 09 11:47:14.383724 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:14.385300 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] VM Started (Lifecycle Event) Jun 09 11:47:14.414046 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Updated VIF entry in instance network info cache for port 0c770421-8b9b-4ee3-959c-0f0a85cedc6b. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:14.418911 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Updating instance_info_cache with network_info: [{"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:14.440354 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:14.580865 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.591156 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.613015 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.624829 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:14.634957 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:14.785780 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Updating instance_info_cache with network_info: [{"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:14.880307 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4c5e8f72-da3f-4f2c-882b-f939001df2c2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "094562bc-f7ad-4b9a-a2cc-ca68d7b7c579" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 25.727s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:14.891559 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:14.897121 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-changed-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:14.897343 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Refreshing instance network info cache due to event network-changed-df464bce-a7f9-41c4-9aa2-ce240dc07d47. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:14.897551 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] Acquiring lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:14.900103 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] Acquired lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:14.900300 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Refreshing network info cache for port df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:14.903820 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:14.926867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-60af9f20-33fc-4914-ba71-b86702c602e3 req-e68d9741-6e5e-4cf9-b720-11e1937f73c6 service nova] Releasing lock "refresh_cache-f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:15.140639 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.170s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:15.140639 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:15.239478 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.289348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Releasing lock "refresh_cache-9e09fd87-2029-4130-9679-3c73b357cfd7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:15.289617 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Instance network_info: |[{"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:15.289919 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] Acquired lock "refresh_cache-9e09fd87-2029-4130-9679-3c73b357cfd7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:15.290085 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Refreshing network info cache for port 5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:15.291941 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Start _get_guest_xml network_info=[{"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:15.294709 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:15.296344 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1762806107', uuid='9e09fd87-2029-4130-9679-3c73b357cfd7'), owner=OwnerMeta(userid='b5ac4f1fac1e4dfbbc2e97d1aaa39971', username='tempest-ServersNegativeTestJSON-2084585060-project-member', projectid='82ec66aa0aa54ed1b5f0ca42b1f529a9', projectname='tempest-ServersNegativeTestJSON-2084585060'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005635.2957923) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:15.298229 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:15.298573 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:15.299517 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:15.299800 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:15.300654 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:15.300986 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:15.301105 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:15.301191 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:15.301336 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:15.301421 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:15.301550 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:15.301666 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:15.301769 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:15.301885 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:15.301974 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:15.302103 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:15.315699 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1762806107',display_name='tempest-ServersNegativeTestJSON-server-1762806107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serversnegativetestjson-server-1762806107',id=10,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ec66aa0aa54ed1b5f0ca42b1f529a9',ramdisk_id='',reservation_id='r-vt4c808n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2084585060',owner_user_name='tempest-ServersNegativeTestJSON-2084585060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:13Z,user_data=None,user_id='b5ac4f1fac1e4dfbbc2e97d1aaa39971',uuid=9e09fd87-2029-4130-9679-3c73b357cfd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:15.315933 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converting VIF {"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:15.317447 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:15.318360 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e09fd87-2029-4130-9679-3c73b357cfd7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:15.403970 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:15.407532 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:15.407669 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] VM Paused (Lifecycle Event) Jun 09 11:47:15.567847 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:15.568047 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:15.568281 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No VIF found with MAC fa:16:3e:2d:5b:bd, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:15.568874 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Using config drive Jun 09 11:47:15.647167 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:15.647455 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:15.647797 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:15.648460 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:15.787066 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-plugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:15.789740 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:15.790039 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:15.790169 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Processing event network-vif-plugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-plugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] No waiting events found dispatching network-vif-plugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-599df0c2-2f95-416a-9a32-fc1b59909b64 req-146e4157-7b6a-424a-8de1-aa0029e37833 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received unexpected event network-vif-plugged-e8a74c52-55ef-4f12-811a-9909791cf2be for instance with vm_state building and task_state spawning. Jun 09 11:47:15.791576 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:15.798528 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:15.801814 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:15.807805 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Instance spawned successfully. Jun 09 11:47:15.807805 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:15.827247 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbd75a95df64400a7a3db15ee91196e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b166f86497e4dbfb0ea7e1850584656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] End _get_guest_xml xml= Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 9e09fd87-2029-4130-9679-3c73b357cfd7 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: instance-0000000a Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: tempest-ServersNegativeTestJSON-server-1762806107 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 2026-06-09 11:47:15 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: True Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: bare Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: tempest-ServersNegativeTestJSON-2084585060-project-member Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: tempest-ServersNegativeTestJSON-2084585060 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 9e09fd87-2029-4130-9679-3c73b357cfd7 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 9e09fd87-2029-4130-9679-3c73b357cfd7 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: Jun 09 11:47:15.830647 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:15.835518 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Preparing to wait for external event network-vif-plugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:15.835819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:15.836007 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:15.836163 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:15.836794 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1762806107',display_name='tempest-ServersNegativeTestJSON-server-1762806107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serversnegativetestjson-server-1762806107',id=10,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ec66aa0aa54ed1b5f0ca42b1f529a9',ramdisk_id='',reservation_id='r-vt4c808n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2084585060',owner_user_name='tempest-ServersNegativeTestJSON-2084585060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:13Z,user_data=None,user_id='b5ac4f1fac1e4dfbbc2e97d1aaa39971',uuid=9e09fd87-2029-4130-9679-3c73b357cfd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:15.837284 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converting VIF {"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:15.837529 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:15.837662 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:15.838985 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.839341 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:15.840872 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:15.841483 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.841657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12683a9c-1918-56e5-bc86-8f65171717a4', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:15.842328 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.844626 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:15.850364 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.858536 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.858850 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5305a225-72, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:15.859657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5305a225-72, col_values=(('qos', UUID('d38140f5-ff25-487a-b4a7-4d19dd9fe8a2')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:15.862059 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5305a225-72, col_values=(('external_ids', {'iface-id': '5305a225-7233-4cb2-a00c-70e3cd22fadd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:eb:0e', 'vm-uuid': '9e09fd87-2029-4130-9679-3c73b357cfd7'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:15.869322 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.870583 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:15.881464 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:15.885053 np0000002435 nova-compute[98325]: INFO os_vif [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') Jun 09 11:47:15.911456 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:15.915275 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:15.916220 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Resumed (Lifecycle Event) Jun 09 11:47:16.079613 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:16.123640 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:16.155593 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:16.324911 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:16.325059 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:16.325431 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:16.325690 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:16.325918 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:16.326154 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:16.356805 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Successfully created port: 930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:16.418293 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Creating config drive at /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk.config Jun 09 11:47:16.419894 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Updated VIF entry in instance network info cache for port df464bce-a7f9-41c4-9aa2-ce240dc07d47. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:16.421051 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Updating instance_info_cache with network_info: [{"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:16.425723 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:16.435322 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:16.452377 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc7rmz6ej {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:16.492588 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:16.497776 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:16.498128 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.007s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:16.498506 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:16.498731 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Processing event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:16.500915 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc7rmz6ej" returned: 0 in 0.048s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:16.501505 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:16.502824 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:16.502824 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:16.502824 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:16.502824 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:16.503031 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:16.503031 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state building and task_state spawning. Jun 09 11:47:16.503254 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:16.503359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:16.503510 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:16.503616 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:16.504116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] No event matching network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf in dict_keys([('network-vif-plugged', '49bd34b5-99d7-4615-9653-01ff6a59c4cf')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:47:16.504186 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-db88cb67-058e-45f6-a135-eb1ec5973e78 req-79b5ded0-e59d-45d5-91ea-39ed002bbe86 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received unexpected event network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf for instance with vm_state building and task_state spawning. Jun 09 11:47:16.513128 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:16.516797 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance spawned successfully. Jun 09 11:47:16.517143 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:16.550217 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:16.666428 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:16.767657 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Updated VIF entry in instance network info cache for port 5305a225-7233-4cb2-a00c-70e3cd22fadd. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:16.768304 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Updating instance_info_cache with network_info: [{"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:16.835486 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Took 8.75 seconds to spawn the instance on the hypervisor. Jun 09 11:47:16.835667 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:16.929927 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-593c0b5b-7816-4943-9d56-84ae10777e73 req-56a208da-1ea9-4cac-ae35-d23ce76b6b66 service nova] Releasing lock "refresh_cache-3c6c08b5-e35f-48de-8928-810d426a8122" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:16.939587 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:16.939743 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] VM Resumed (Lifecycle Event) Jun 09 11:47:17.038712 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:17.039289 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:17.039289 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:17.039422 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:17.039658 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:17.039880 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:17.063111 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:17.103009 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:17.113770 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:17.174358 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Booting with blank volume at /dev/vda Jun 09 11:47:17.221189 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Successfully updated port: 930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:17.270463 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-aa91943d-f7cc-4fc6-ac33-c5f92f74d290 req-10d5e0a8-74af-4cc1-9f55-703b7450b1bd service nova] Releasing lock "refresh_cache-9e09fd87-2029-4130-9679-3c73b357cfd7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:17.283616 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:17.318115 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-changed-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:17.318284 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Refreshing instance network info cache due to event network-changed-930eb8bb-2d85-44fe-a9ed-6d0e6885242e. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:17.318463 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] Acquiring lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:17.318572 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] Acquired lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:17.318708 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Refreshing network info cache for port 930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:17.351505 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Took 14.59 seconds to build instance. Jun 09 11:47:17.356982 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:17.365206 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:17.445990 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:17.448386 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:17.452556 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:17.454279 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:17.454908 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] No VIF found with MAC fa:16:3e:5d:eb:0e, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:17.455466 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Using config drive Jun 09 11:47:17.550293 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Took 21.00 seconds to spawn the instance on the hypervisor. Jun 09 11:47:17.550293 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:17.730489 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:17.823984 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:17.857944 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.109s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:17.861956 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:17.862357 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing instance network info cache due to event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:17.862526 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:17.862664 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:17.862729 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:17.912032 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:17.954659 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:17.954806 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] VM Started (Lifecycle Event) Jun 09 11:47:17.968124 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:18.067062 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Took 30.82 seconds to build instance. Jun 09 11:47:18.073998 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:18.121479 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Creating config drive at /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk.config Jun 09 11:47:18.124880 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps6_3qhjf {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:18.159447 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:18.159711 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:18.177405 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps6_3qhjf" returned: 0 in 0.052s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:18.365333 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:18.458750 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:18.460595 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:18.559635 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-plugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:18.559935 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:18.560090 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:18.560240 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:18.560424 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Processing event network-vif-plugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:18.562523 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-plugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:18.563002 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:18.563002 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:18.563002 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:18.563240 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] No waiting events found dispatching network-vif-plugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:18.563240 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5d7e4a06-1774-4fbe-892c-cffe7aa42879 req-8fc809e8-fa6f-4130-a47b-5fd848ff7468 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received unexpected event network-vif-plugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf for instance with vm_state building and task_state spawning. Jun 09 11:47:18.564907 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:18.569555 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:18.570004 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-6d4854f5-30b3-48d6-808b-acb145890afa tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 32.331s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:18.573224 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Instance spawned successfully. Jun 09 11:47:18.576101 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:18.578677 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3a4d0d05-3302-476b-9edf-0359d1ee4760 req-ac57d717-b598-4c55-9ed8-5a90bbf08f7e service nova] Releasing lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:18.578917 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:18.579244 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:18.662343 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:18.668681 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:18.690795 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:18.803760 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:18.870327 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:18.967338 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:18.967338 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] VM Paused (Lifecycle Event) Jun 09 11:47:19.002218 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:19.004478 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:19.051951 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.053840 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.055898 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.060306 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.060306 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.060306 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.063430 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.063430 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:47:19.063430 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:47:19.102072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:19.102072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:19.102072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:19.102072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:19.102072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:19.102072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:19.225819 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updated VIF entry in instance network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:19.225819 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:19.258078 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:19.364669 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:19.364731 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:19.377680 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:19.377841 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Claim successful on node np0000002435 Jun 09 11:47:19.423607 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-64100ea1-cedc-49f3-9c50-221169ba4dab req-86b60ab6-4287-4e68-ab2f-8c15eb2924ad service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-plugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:19.423607 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-64100ea1-cedc-49f3-9c50-221169ba4dab req-86b60ab6-4287-4e68-ab2f-8c15eb2924ad service nova] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:19.423607 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-64100ea1-cedc-49f3-9c50-221169ba4dab req-86b60ab6-4287-4e68-ab2f-8c15eb2924ad service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:19.425091 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-64100ea1-cedc-49f3-9c50-221169ba4dab req-86b60ab6-4287-4e68-ab2f-8c15eb2924ad service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:19.426824 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-64100ea1-cedc-49f3-9c50-221169ba4dab req-86b60ab6-4287-4e68-ab2f-8c15eb2924ad service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Processing event network-vif-plugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:19.474328 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:19.481104 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:19.481104 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] VM Resumed (Lifecycle Event) Jun 09 11:47:19.527212 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:19.576064 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:19.621986 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Took 8.91 seconds to spawn the instance on the hypervisor. Jun 09 11:47:19.621986 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:19.727942 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a4e00ba0-db7a-4315-aefa-120e5e7f9f29 req-e567dd8b-d8b3-4a63-b15f-75b8a55c5bb6 service nova] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:19.729645 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Updating instance_info_cache with network_info: [{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:19.756470 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:19.759669 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:19.760870 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Instance spawned successfully. Jun 09 11:47:19.761243 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:19.982738 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:19.987938 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:20.133306 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Took 17.34 seconds to build instance. Jun 09 11:47:20.231604 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:20.231839 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance network_info: |[{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:20.243662 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:20.265705 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:20.265825 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:20.266068 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:20.266303 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:20.266849 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:20.266849 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:20.490524 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:20.491065 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Resumed (Lifecycle Event) Jun 09 11:47:20.619220 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-changed-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:20.619375 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Refreshing instance network info cache due to event network-changed-dfc607e9-d1c6-474b-b876-d24787b0e300. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:20.620507 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:20.620507 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:20.620507 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Refreshing network info cache for port dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:20.634137 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.855s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:20.770369 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Took 7.24 seconds to spawn the instance on the hypervisor. Jun 09 11:47:20.770490 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:20.783185 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:20.800440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:47:20.834312 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:20.865198 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:47:20.865475 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:47:20.868290 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:20.874771 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:47:20.876175 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fe60:86b6', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::94c2:47ff:feae:f3b7', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe5d:eb0e'] Jun 09 11:47:20.876290 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:47:20.876403 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:47:20.876609 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:20.876799 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Updating existing volume attachment record: 536b1733-e9c7-4de4-877d-e98a77f142ae {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:47:20.993376 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:20.995001 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:21.126373 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:21.284910 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Took 17.14 seconds to build instance. Jun 09 11:47:21.327700 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:21.327893 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:21.498616 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:21.498990 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] VM Started (Lifecycle Event) Jun 09 11:47:21.505112 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-be3227bc-89be-4f25-b7d2-3820cbf24cd6 req-606cdfb2-7b2c-4fa3-a7db-56abb57e82ee service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-plugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:21.505195 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-be3227bc-89be-4f25-b7d2-3820cbf24cd6 req-606cdfb2-7b2c-4fa3-a7db-56abb57e82ee service nova] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:21.505433 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-be3227bc-89be-4f25-b7d2-3820cbf24cd6 req-606cdfb2-7b2c-4fa3-a7db-56abb57e82ee service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:21.505635 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-be3227bc-89be-4f25-b7d2-3820cbf24cd6 req-606cdfb2-7b2c-4fa3-a7db-56abb57e82ee service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:21.506370 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-be3227bc-89be-4f25-b7d2-3820cbf24cd6 req-606cdfb2-7b2c-4fa3-a7db-56abb57e82ee service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] No waiting events found dispatching network-vif-plugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:21.506559 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-be3227bc-89be-4f25-b7d2-3820cbf24cd6 req-606cdfb2-7b2c-4fa3-a7db-56abb57e82ee service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received unexpected event network-vif-plugged-5305a225-7233-4cb2-a00c-70e3cd22fadd for instance with vm_state active and task_state None. Jun 09 11:47:21.621578 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:21.786719 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.648s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:21.800052 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updated VIF entry in instance network info cache for port dfc607e9-d1c6-474b-b876-d24787b0e300. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:21.800407 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:21.831925 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:22.001915 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:22.005462 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:22.302453 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59fb2c06-d11d-4270-9efa-1d0d35bec618 req-94634fd4-7d4a-4f44-a203-624fafb87740 service nova] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:22.338709 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.974s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:22.339472 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.764s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:22.339789 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:22.341963 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:22.342256 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:47:22.452430 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:22.452553 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:22.452718 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:22.452822 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:22.452919 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:22.454746 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Terminating instance Jun 09 11:47:22.508429 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:22.508955 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] VM Paused (Lifecycle Event) Jun 09 11:47:22.846377 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:22.846536 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:22.846713 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:22.846879 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:22.955928 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d422c8cd17d4fe5b548032f10c7c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3020791dcd4ef4b7980dd196a8ca96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:22.958242 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:47:22.983003 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:22.985199 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.011137 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.012930 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:23.019940 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:23.019940 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] VM Resumed (Lifecycle Event) Jun 09 11:47:23.045959 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Creating image(s) Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Ensure instance console log exists: /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:23.049006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:23.049667 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Start _get_guest_xml network_info=[{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c2f05fbe-de86-4378-8aa5-c047f02ac7b9', 'attached_at': '', 'detached_at': '', 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'serial': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39'}, 'attachment_id': '536b1733-e9c7-4de4-877d-e98a77f142ae', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:23.051853 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:23.053370 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-718577859', uuid='c2f05fbe-de86-4378-8aa5-c047f02ac7b9'), owner=OwnerMeta(userid='ddbd75a95df64400a7a3db15ee91196e', username='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member', projectid='4b166f86497e4dbfb0ea7e1850584656', projectname='tempest-ServerBootFromVolumeStableRescueTest-252292105'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005643.0529783) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:23.054228 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:23.054660 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:23.057007 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:23.057007 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:23.057007 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:23.057367 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:23.057522 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:23.057653 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:23.057809 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:23.057944 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:23.058086 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:23.058318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:23.058477 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:23.058678 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:23.058916 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:23.064536 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:23.083091 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:47:23.083465 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:23.083757 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:23.084336 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:23.084622 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:47:23.100881 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:23.102353 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:23.103649 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:23.103974 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:23.104596 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:23.104939 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:23.117848 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:23.117848 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:23.127747 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:23.127747 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39] added Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:23.133369 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:23.133726 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:23.133726 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:23.133819 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39] added Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:23.139856 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:23.140123 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:23.140123 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:23.140356 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:23.189687 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.197628 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.311720 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Instance destroyed successfully. Jun 09 11:47:23.312458 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lazy-loading 'resources' on Instance uuid 9e09fd87-2029-4130-9679-3c73b357cfd7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:23.350090 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:23.375493 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:23.517887 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:23.519434 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:23.534416 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:23.539519 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:23.630788 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-changed-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:23.633662 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Refreshing instance network info cache due to event network-changed-49bd34b5-99d7-4615-9653-01ff6a59c4cf. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:23.633965 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] Acquiring lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:23.634076 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] Acquired lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:23.634233 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Refreshing network info cache for port 49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:23.644180 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:23.646897 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:23.724128 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:23.727743 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:23.812214 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:23.814956 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:23.832738 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1762806107',display_name='tempest-ServersNegativeTestJSON-server-1762806107',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serversnegativetestjson-server-1762806107',id=10,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:47:20Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='82ec66aa0aa54ed1b5f0ca42b1f529a9',ramdisk_id='',reservation_id='r-vt4c808n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2084585060',owner_user_name='tempest-ServersNegativeTestJSON-2084585060-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:21Z,user_data=None,user_id='b5ac4f1fac1e4dfbbc2e97d1aaa39971',uuid=9e09fd87-2029-4130-9679-3c73b357cfd7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:47:23.833974 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converting VIF {"id": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "address": "fa:16:3e:5d:eb:0e", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5305a225-72", "ovs_interfaceid": "5305a225-7233-4cb2-a00c-70e3cd22fadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:23.836990 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:23.838656 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:47:23.842039 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Successfully created port: d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:23.853943 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.853943 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5305a225-72, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:23.855182 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:23.863858 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:23.867314 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.867974 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d38140f5-ff25-487a-b4a7-4d19dd9fe8a2) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:23.869048 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.869048 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:23.869935 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:23.873315 np0000002435 nova-compute[98325]: INFO os_vif [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:eb:0e,bridge_name='br-int',has_traffic_filtering=True,id=5305a225-7233-4cb2-a00c-70e3cd22fadd,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5305a225-72') Jun 09 11:47:23.873644 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Deleting instance files /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7_del Jun 09 11:47:23.874430 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Deletion of /opt/stack/data/nova/instances/9e09fd87-2029-4130-9679-3c73b357cfd7_del complete Jun 09 11:47:23.889945 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:23.890470 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:23.966000 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:23.968609 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.039926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.039926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.052204 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:24.052396 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] VM Started (Lifecycle Event) Jun 09 11:47:24.116958 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.121478 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.136352 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:24.140065 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:24.146765 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:24.152543 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:24.169249 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.175204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.183665 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.191354 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.191354 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.191354 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:24.193016 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.193016 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.193016 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:24.199343 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.199343 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.199343 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:24.199516 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.199516 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.199516 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:24.234799 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.40.100,3260] Jun 09 11:47:24.234799 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.40.100,3260] successful. Jun 09 11:47:24.234799 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.238918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.239949 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.50.100,3260] Jun 09 11:47:24.239949 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.50.100,3260] successful. Jun 09 11:47:24.239949 np0000002435 nova-compute[98325]: stderr=iscsiadm: could not read session targetname: 5 Jun 09 11:47:24.239949 np0000002435 nova-compute[98325]: iscsiadm: could not find session info for session5 Jun 09 11:47:24.239949 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.243064 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.259657 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.271821 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:24.281387 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.281387 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.281387 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.281387 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.281387 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:24.281711 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.281711 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.281711 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.281711 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.281711 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:24.283060 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:24.283060 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:24.283552 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:24.283703 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:24.298603 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.298603 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.298603 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.298603 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.298603 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:24.307504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:24.312303 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:24.312681 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:24.330981 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.332527 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:24.332705 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:24.338006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.393154 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Took 1.43 seconds to destroy the instance on the hypervisor. Jun 09 11:47:24.394833 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:47:24.397559 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:47:24.397724 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:47:24.398178 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:24.453648 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.462835 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.559141 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:24.565649 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Successfully updated port: d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:24.569630 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:24.569630 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] VM Paused (Lifecycle Event) Jun 09 11:47:24.572997 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.577683 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:47:24.580719 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.612923 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:24.652409 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Received event network-changed-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:24.652586 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Refreshing instance network info cache due to event network-changed-d2200511-b019-4b9e-8324-38a8181f40ca. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:24.652829 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] Acquiring lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:24.652956 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] Acquired lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:24.653124 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Refreshing network info cache for port d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:24.677100 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.680286 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.764484 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.775296 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.848168 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:24.881390 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:24.887055 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:24.887412 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Creating image(s) Jun 09 11:47:24.888144 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:24.888441 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:24.889067 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:24.891478 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:24.903431 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:24.910418 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:24.930843 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:24.935189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:25.034664 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:25.038632 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.129s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.042345 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.046792 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:25.046792 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:25.046792 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:25.048868 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:25.048868 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:25.061457 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '9e09fd87-2029-4130-9679-3c73b357cfd7' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '9e09fd87-2029-4130-9679-3c73b357cfd7' (instance-0000000a) Jun 09 11:47:25.064287 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:25.066828 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:25.086806 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:25.089727 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:25.095375 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:25.095530 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] VM Resumed (Lifecycle Event) Jun 09 11:47:25.105306 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:47:25.106823 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.040s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.107162 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=12432MB free_disk=74.6047477722168GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:47:25.107352 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:25.107528 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:25.110995 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updated VIF entry in instance network info cache for port 49bd34b5-99d7-4615-9653-01ff6a59c4cf. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:25.111306 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updating instance_info_cache with network_info: [{"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:25.142470 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.094s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.142812 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:25.164098 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:25.186582 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk 1073741824" returned: 0 in 0.044s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.188945 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c6debec8-7878-4d48-bc4c-ed6c54232c28 req-91533516-61dc-4cd5-bc4b-1f22971bf76d service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-deleted-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:25.190935 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.145s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:25.191239 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:25.191622 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-c6debec8-7878-4d48-bc4c-ed6c54232c28 req-91533516-61dc-4cd5-bc4b-1f22971bf76d service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Neutron deleted interface 5305a225-7233-4cb2-a00c-70e3cd22fadd; detaching it from the instance and deleting it from the info cache Jun 09 11:47:25.210284 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c6debec8-7878-4d48-bc4c-ed6c54232c28 req-91533516-61dc-4cd5-bc4b-1f22971bf76d service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Detach interface failed, port_id=5305a225-7233-4cb2-a00c-70e3cd22fadd, reason: Instance 9e09fd87-2029-4130-9679-3c73b357cfd7 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:47:25.244590 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:25.258703 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:25.263737 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.072s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.264474 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:25.265808 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:25.341859 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:25.342298 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Cannot resize image /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:25.342755 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:25.342955 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Ensure instance console log exists: /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:25.343495 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:25.343795 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:25.343939 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:25.484654 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:25.602358 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:25.605754 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999234948000094 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:25.605876 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99897666400011 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:25.606011 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998848133000138 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:25.613528 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] Releasing lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:25.613824 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-unplugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:25.614127 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:25.614380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:25.614625 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:25.614686 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] No waiting events found dispatching network-vif-unplugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:25.614868 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e33e7cfd-06a9-4311-a2ef-4f84e1a8a919 req-aaedef07-c0e3-45fe-8493-e1c657d794be service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-unplugged-5305a225-7233-4cb2-a00c-70e3cd22fadd for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:47:25.629129 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:25.696246 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a9a42193-7c51-412e-8f2f-616d3c79bcd4 req-c179f262-76b4-4f7f-8139-d34f77672cc8 service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-unplugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:25.696928 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a9a42193-7c51-412e-8f2f-616d3c79bcd4 req-c179f262-76b4-4f7f-8139-d34f77672cc8 service nova] Acquiring lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:25.697168 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a9a42193-7c51-412e-8f2f-616d3c79bcd4 req-c179f262-76b4-4f7f-8139-d34f77672cc8 service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:25.697423 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a9a42193-7c51-412e-8f2f-616d3c79bcd4 req-c179f262-76b4-4f7f-8139-d34f77672cc8 service nova] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:25.697605 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a9a42193-7c51-412e-8f2f-616d3c79bcd4 req-c179f262-76b4-4f7f-8139-d34f77672cc8 service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] No waiting events found dispatching network-vif-unplugged-5305a225-7233-4cb2-a00c-70e3cd22fadd {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:25.697785 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a9a42193-7c51-412e-8f2f-616d3c79bcd4 req-c179f262-76b4-4f7f-8139-d34f77672cc8 service nova] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Received event network-vif-unplugged-5305a225-7233-4cb2-a00c-70e3cd22fadd for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:47:25.989809 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-35c5fcd0-5c98-447b-bdc1-5d5d29570b4e req-01a5996a-de4e-4d59-b917-4d174192512e service nova] Releasing lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:25.990654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:25.990812 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:26.130563 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Found WWN 33000000058f02a3c for multipath device dm-3 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:47:26.130891 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:26.131075 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '33000000058f02a3c', 'path': '/dev/dm-3', 'multipath_id': '33000000058f02a3c'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:26.131189 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058f02a3c', 'path': '/dev/dm-3', 'multipath_id': '33000000058f02a3c'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:47:26.135771 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Took 1.74 seconds to deallocate network for instance. Jun 09 11:47:26.213546 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 54835fc7-b0b9-4113-90ad-797bdac45590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.214497 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance dae1d031-f9ec-4441-878d-be97ec49b42f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.214643 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance f973e06e-5d44-4393-abce-509f80f2db62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.214780 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance c5797bda-6c93-417f-be59-a3c76be89e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 3c6c08b5-e35f-48de-8928-810d426a8122 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 909cacb1-a84f-45bf-b343-ab2e830208c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 20e2f567-45b9-4beb-b58c-6e62b337525d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 9e09fd87-2029-4130-9679-3c73b357cfd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance c2f05fbe-de86-4378-8aa5-c047f02ac7b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:47:26.217286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:47:25 up 30 min, 2 users, load average: 6.97, 2.77, 1.28\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_4b166f86497e4dbfb0ea7e1850584656': '2', 'io_workload': '2', 'num_proj_82ec66aa0aa54ed1b5f0ca42b1f529a9': '2', 'num_proj_97413552cb514828acbb1e9f9de02eda': '1', 'num_proj_ef6342a70d63478b87507cf6ab897736': '1', 'num_proj_9e3020791dcd4ef4b7980dd196a8ca96': '2', 'num_proj_a68e42f95c184ecab12e38e66deeb515': '1', 'num_proj_94c0b97f88c340218d8db8e1e6e13187': '1', 'num_proj_94910fada777407994d5908d5c1de121': '2', 'num_task_deleting': '1', 'num_vm_building': '2', 'num_task_spawning': '2'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:47:26.571075 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:26.639015 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718577859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-718577859',id=11,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-90li3eum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:17Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=c2f05fbe-de86-4378-8aa5-c047f02ac7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:26.639646 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:26.640285 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:26.643639 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:26.645128 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'pci_devices' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:26.786394 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:26.955331 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updating instance_info_cache with network_info: [{"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:27.066511 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:27.066737 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] End _get_guest_xml xml= Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: instance-0000000b Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-server-718577859 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 2026-06-09 11:47:23 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: True Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: bare Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: 70e2a824-5ff4-43e3-90b1-eb8fe3827f39 Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: Jun 09 11:47:27.148961 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:27.151920 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Preparing to wait for external event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:27.151920 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:27.151920 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:27.151920 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:27.151920 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718577859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-718577859',id=11,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-90li3eum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:17Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=c2f05fbe-de86-4378-8aa5-c047f02ac7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:27.152251 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:27.152251 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:27.152251 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:27.152251 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:27.152251 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:27.152519 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:27.153412 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:27.153591 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94e9f1f0-29ba-5ace-912d-1df0da90cfc8', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:27.160541 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:27.161611 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:27.163591 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:27.163783 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap930eb8bb-2d, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:27.164148 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap930eb8bb-2d, col_values=(('qos', UUID('8e331b6c-9d32-440f-a1a9-8b4860b9e474')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:27.164377 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap930eb8bb-2d, col_values=(('external_ids', {'iface-id': '930eb8bb-2d85-44fe-a9ed-6d0e6885242e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c9:62', 'vm-uuid': 'c2f05fbe-de86-4378-8aa5-c047f02ac7b9'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:27.165240 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:27.168511 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:27.172321 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:27.173313 np0000002435 nova-compute[98325]: INFO os_vif [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') Jun 09 11:47:27.457539 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:27.457739 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Instance network_info: |[{"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:27.460689 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Start _get_guest_xml network_info=[{"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:27.462401 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:27.465044 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='4b3d0e3a-0700-4b3d-8691-c30a18104acc'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005647.4646215) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:27.466321 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:27.466321 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:27.466997 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:27.467159 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:27.467979 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:27.468255 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:27.468388 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:27.469453 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:27.491999 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=12,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-df5vanbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=4b3d0e3a-0700-4b3d-8691-c30a18104acc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:27.492215 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:27.493114 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:e9,bridge_name='br-int',has_traffic_filtering=True,id=d2200511-b019-4b9e-8324-38a8181f40ca,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2200511-b0') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:27.493242 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b3d0e3a-0700-4b3d-8691-c30a18104acc {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:27.569205 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] End _get_guest_xml xml= Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 4b3d0e3a-0700-4b3d-8691-c30a18104acc Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: instance-0000000c Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: multiattach-server-0 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 2026-06-09 11:47:27 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: True Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: bare Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 4b3d0e3a-0700-4b3d-8691-c30a18104acc Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 4b3d0e3a-0700-4b3d-8691-c30a18104acc Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: Jun 09 11:47:27.996102 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:27.998196 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Preparing to wait for external event network-vif-plugged-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:27.998196 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:27.998196 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:27.998196 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:27.999282 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=12,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-df5vanbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=4b3d0e3a-0700-4b3d-8691-c30a18104acc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:27.999494 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:28.000091 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:e9,bridge_name='br-int',has_traffic_filtering=True,id=d2200511-b019-4b9e-8324-38a8181f40ca,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2200511-b0') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:28.000380 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:e9,bridge_name='br-int',has_traffic_filtering=True,id=d2200511-b019-4b9e-8324-38a8181f40ca,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2200511-b0') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:28.000602 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.000811 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:28.000996 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:28.002023 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.002190 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7146731b-96a1-5e57-ade2-1d23dcc6d8b3', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:28.002996 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.003587 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:28.009107 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.011368 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.011552 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2200511-b0, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:28.011848 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2200511-b0, col_values=(('qos', UUID('11560ff0-c81a-4e2b-8bcd-f543f086aa3f')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:28.012000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2200511-b0, col_values=(('external_ids', {'iface-id': 'd2200511-b019-4b9e-8324-38a8181f40ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:50:e9', 'vm-uuid': '4b3d0e3a-0700-4b3d-8691-c30a18104acc'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:28.013715 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.015535 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:28.025823 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:28.026872 np0000002435 nova-compute[98325]: INFO os_vif [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:e9,bridge_name='br-int',has_traffic_filtering=True,id=d2200511-b019-4b9e-8324-38a8181f40ca,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2200511-b0') Jun 09 11:47:28.075893 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:47:28.076046 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.968s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:28.076218 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.433s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:28.076564 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.74 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:47:28.695543 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:28.696841 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:28.697095 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No VIF found with MAC fa:16:3e:54:c9:62, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:28.697800 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Using config drive Jun 09 11:47:28.798359 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:28.798583 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:29.204784 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:29.301016 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:29.339651 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Creating config drive at /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config Jun 09 11:47:29.345864 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptjo4nim2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:29.396230 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptjo4nim2" returned: 0 in 0.050s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:29.542193 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:29.542398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:29.542398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:8e:50:e9, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:29.542951 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Using config drive Jun 09 11:47:29.811151 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.735s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:29.873782 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Deleted allocations for instance 9e09fd87-2029-4130-9679-3c73b357cfd7 Jun 09 11:47:29.890362 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:29.925435 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:29.932390 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.042012 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.056308 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:30.097837 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.105958 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.246866 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.294040 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c0e1bc8c-dde7-4983-b58b-2841716d2e7d req-28199307-843a-45e8-aeac-c4fef6a82a5d service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:30.296079 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c0e1bc8c-dde7-4983-b58b-2841716d2e7d req-28199307-843a-45e8-aeac-c4fef6a82a5d service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:30.296300 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c0e1bc8c-dde7-4983-b58b-2841716d2e7d req-28199307-843a-45e8-aeac-c4fef6a82a5d service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:30.296439 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c0e1bc8c-dde7-4983-b58b-2841716d2e7d req-28199307-843a-45e8-aeac-c4fef6a82a5d service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:30.302984 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Creating config drive at /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk.config Jun 09 11:47:30.303398 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c0e1bc8c-dde7-4983-b58b-2841716d2e7d req-28199307-843a-45e8-aeac-c4fef6a82a5d service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Processing event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:30.310702 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpen5c4gio {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:30.355912 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpen5c4gio" returned: 0 in 0.046s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:30.850935 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.871342 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.874617 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:30.895479 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-48f467f9-8c17-4135-a574-d6c09a13cb0d tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "9e09fd87-2029-4130-9679-3c73b357cfd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.443s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:30.998153 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:30.998741 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Started (Lifecycle Event) Jun 09 11:47:31.004527 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:31.014693 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:31.019436 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance spawned successfully. Jun 09 11:47:31.020479 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:31.023055 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:31.065037 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:31.504927 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:31.509486 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:31.526879 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:31.529298 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:31.529298 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:31.529298 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:31.529298 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:31.529298 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:32.011517 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:47:32.011833 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:32.011899 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Paused (Lifecycle Event) Jun 09 11:47:32.033837 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Took 8.99 seconds to spawn the instance on the hypervisor. Jun 09 11:47:32.033837 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:32.385161 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:32.385602 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:32.386348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:32.386401 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:32.386546 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:32.386675 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state None. Jun 09 11:47:32.386817 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Received event network-vif-plugged-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:32.386957 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:32.387097 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:32.387226 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:32.387389 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Processing event network-vif-plugged-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:32.387544 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Received event network-vif-plugged-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:32.387690 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:32.387827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:32.387955 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:32.388083 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] No waiting events found dispatching network-vif-plugged-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:32.388245 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-b37e5074-38e9-4e23-b644-dccde18442d9 req-388427e7-48e2-4153-9a6e-5c8c5a327a3f service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Received unexpected event network-vif-plugged-d2200511-b019-4b9e-8324-38a8181f40ca for instance with vm_state building and task_state spawning. Jun 09 11:47:32.388918 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:32.397333 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:32.399078 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Instance spawned successfully. Jun 09 11:47:32.400505 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:32.514218 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:32.516413 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:32.516561 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Resumed (Lifecycle Event) Jun 09 11:47:32.540634 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Took 20.64 seconds to build instance. Jun 09 11:47:32.906603 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:32.906820 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:32.907095 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:32.907488 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:32.907755 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:32.908031 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:33.025740 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:33.026649 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:33.027076 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:33.044331 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.153s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:33.415679 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Took 8.53 seconds to spawn the instance on the hypervisor. Jun 09 11:47:33.416104 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:33.529670 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:33.530071 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] VM Started (Lifecycle Event) Jun 09 11:47:33.926476 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Took 14.75 seconds to build instance. Jun 09 11:47:34.033177 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:34.035380 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:34.216835 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Rescuing Jun 09 11:47:34.217447 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:34.217447 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:34.217447 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:34.427661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4f49ba5c-b150-4ed4-95c2-620203ec66f8 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.268s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:34.539973 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:34.539973 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] VM Paused (Lifecycle Event) Jun 09 11:47:34.616585 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Received event network-changed-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:34.618213 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Refreshing instance network info cache due to event network-changed-d2200511-b019-4b9e-8324-38a8181f40ca. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:34.618421 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] Acquiring lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:34.618515 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] Acquired lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:34.618626 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Refreshing network info cache for port d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:34.719697 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:35.025206 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:35.045021 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:35.046430 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:35.046518 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] VM Resumed (Lifecycle Event) Jun 09 11:47:35.121966 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:35.172291 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Updating instance_info_cache with network_info: [{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:35.249577 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:35.439628 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:35.549820 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:35.552536 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:35.589451 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updated VIF entry in instance network info cache for port d2200511-b019-4b9e-8324-38a8181f40ca. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:35.590173 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updating instance_info_cache with network_info: [{"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:35.674340 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:35.870061 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:35.870248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:36.092145 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8408986-0296-4e05-9243-4e0d3576525d req-8bb20e16-d62e-4500-a429-775b734e9536 service nova] Releasing lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:36.372176 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:36.924606 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:36.925194 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:36.927407 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:36.927512 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Claim successful on node np0000002435 Jun 09 11:47:37.262686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:37.262826 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:37.262961 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:37.263115 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:37.263258 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:37.264983 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Terminating instance Jun 09 11:47:37.295847 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.321600 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.452696 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.459029 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.465480 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d9554496-b227-408e-9805-ce396008c0f3 req-5738e9e5-d7aa-4f42-aabc-02e66a2ae915 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:37.465644 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d9554496-b227-408e-9805-ce396008c0f3 req-5738e9e5-d7aa-4f42-aabc-02e66a2ae915 service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:37.466105 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d9554496-b227-408e-9805-ce396008c0f3 req-5738e9e5-d7aa-4f42-aabc-02e66a2ae915 service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:37.466174 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d9554496-b227-408e-9805-ce396008c0f3 req-5738e9e5-d7aa-4f42-aabc-02e66a2ae915 service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:37.466333 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d9554496-b227-408e-9805-ce396008c0f3 req-5738e9e5-d7aa-4f42-aabc-02e66a2ae915 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:37.466464 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-d9554496-b227-408e-9805-ce396008c0f3 req-5738e9e5-d7aa-4f42-aabc-02e66a2ae915 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state rescuing. Jun 09 11:47:37.591872 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.604639 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.652235 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99947214100007 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:37.653861 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance destroyed successfully. Jun 09 11:47:37.653861 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'numa_topology' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:37.767646 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:47:37.788439 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.791629 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.810545 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.822648 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.846683 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:37.953480 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-92c6dbe6-47f4-4412-8e55-71f2eab45dee req-3862d951-34c9-4ece-a0cd-3cac0b9491a5 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:37.953480 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-92c6dbe6-47f4-4412-8e55-71f2eab45dee req-3862d951-34c9-4ece-a0cd-3cac0b9491a5 service nova] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:37.953819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-92c6dbe6-47f4-4412-8e55-71f2eab45dee req-3862d951-34c9-4ece-a0cd-3cac0b9491a5 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:37.953819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-92c6dbe6-47f4-4412-8e55-71f2eab45dee req-3862d951-34c9-4ece-a0cd-3cac0b9491a5 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:37.953878 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-92c6dbe6-47f4-4412-8e55-71f2eab45dee req-3862d951-34c9-4ece-a0cd-3cac0b9491a5 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] No waiting events found dispatching network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:37.954031 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-92c6dbe6-47f4-4412-8e55-71f2eab45dee req-3862d951-34c9-4ece-a0cd-3cac0b9491a5 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:47:38.027642 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.106514 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99969318400008 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:38.108295 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Instance destroyed successfully. Jun 09 11:47:38.108295 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lazy-loading 'resources' on Instance uuid dae1d031-f9ec-4441-878d-be97ec49b42f {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:38.159439 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Attempting a stable device rescue Jun 09 11:47:38.257976 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 09 11:47:38.261230 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:47:38.261374 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Creating image(s) Jun 09 11:47:38.261871 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:38.261986 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:38.262500 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:38.262657 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'trusted_certs' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:38.522594 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:38.522803 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:38.610144 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-896162405',display_name='tempest-ServersNegativeTestJSON-server-896162405',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serversnegativetestjson-server-896162405',id=2,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:46:59Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='82ec66aa0aa54ed1b5f0ca42b1f529a9',ramdisk_id='',reservation_id='r-9cvdaxj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2084585060',owner_user_name='tempest-ServersNegativeTestJSON-2084585060-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:00Z,user_data=None,user_id='b5ac4f1fac1e4dfbbc2e97d1aaa39971',uuid=dae1d031-f9ec-4441-878d-be97ec49b42f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:47:38.610354 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converting VIF {"id": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "address": "fa:16:3e:60:86:b6", "network": {"id": "b2114b2d-97b3-4d33-bfed-d6bd768b8d37", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1459045036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "82ec66aa0aa54ed1b5f0ca42b1f529a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed2f3a2-a9", "ovs_interfaceid": "5ed2f3a2-a9d6-4f3a-b967-2427b009b18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:38.610850 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:38.611087 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:47:38.612693 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.612879 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed2f3a2-a9, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:38.613872 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.614882 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:38.619522 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.620481 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.620628 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee892d9a-cec9-4720-9460-1bc64daa58d7) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:38.621118 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.621855 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:38.626694 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:38.628519 np0000002435 nova-compute[98325]: INFO os_vif [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:b6,bridge_name='br-int',has_traffic_filtering=True,id=5ed2f3a2-a9d6-4f3a-b967-2427b009b18b,network=Network(b2114b2d-97b3-4d33-bfed-d6bd768b8d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed2f3a2-a9') Jun 09 11:47:38.628825 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Deleting instance files /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f_del Jun 09 11:47:38.629667 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Deletion of /opt/stack/data/nova/instances/dae1d031-f9ec-4441-878d-be97ec49b42f_del complete Jun 09 11:47:38.764771 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:38.765015 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "dd015266fc081d9bfd1df26bb6abe66487a0edbb" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:38.765421 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "dd015266fc081d9bfd1df26bb6abe66487a0edbb" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:39.025156 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:39.135631 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Took 1.37 seconds to destroy the instance on the hypervisor. Jun 09 11:47:39.136152 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:47:39.136804 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:47:39.136804 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:47:39.136804 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:39.239633 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:39.532925 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.606s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:39.533455 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:47:39.543586 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df51c8c1-615e-4d46-81e0-daeeeecc145f req-cac095e6-1151-48cd-bea0-ee70e2af4916 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:39.544135 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df51c8c1-615e-4d46-81e0-daeeeecc145f req-cac095e6-1151-48cd-bea0-ee70e2af4916 service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:39.544226 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df51c8c1-615e-4d46-81e0-daeeeecc145f req-cac095e6-1151-48cd-bea0-ee70e2af4916 service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:39.544368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df51c8c1-615e-4d46-81e0-daeeeecc145f req-cac095e6-1151-48cd-bea0-ee70e2af4916 service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:39.544586 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df51c8c1-615e-4d46-81e0-daeeeecc145f req-cac095e6-1151-48cd-bea0-ee70e2af4916 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:39.544721 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-df51c8c1-615e-4d46-81e0-daeeeecc145f req-cac095e6-1151-48cd-bea0-ee70e2af4916 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state rescuing. Jun 09 11:47:39.614620 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:39.618278 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:39.618674 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:39.714216 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.part --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:39.714541 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ee37cfdf-748a-4fe1-9c51-e737fe3ffa1a was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:47:39.715166 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:47:39.715479 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.part /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:39.776170 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.part /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.converted" returned: 0 in 0.060s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:39.783576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:39.871929 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:39.872819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "dd015266fc081d9bfd1df26bb6abe66487a0edbb" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.107s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:39.873361 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:39.877521 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:39.878702 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "dd015266fc081d9bfd1df26bb6abe66487a0edbb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:39.879182 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "dd015266fc081d9bfd1df26bb6abe66487a0edbb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:39.879573 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:39.882908 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:39.883320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:39.959907 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb --force-share --output=json" returned: 0 in 0.076s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:39.960886 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb,backing_fmt=raw /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.rescue {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:39.999927 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd015266fc081d9bfd1df26bb6abe66487a0edbb,backing_fmt=raw /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.rescue" returned: 0 in 0.039s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:40.001881 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "dd015266fc081d9bfd1df26bb6abe66487a0edbb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.123s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:40.002275 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'migration_context' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:40.017952 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:40.050351 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:47:40.050849 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:47:40.051879 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:40.053308 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:40.060395 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9cc6a922-5a0a-4095-9238-483213b72fdf req-08d5e42e-e6cb-40c3-9e5d-3964a242b567 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:40.060927 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9cc6a922-5a0a-4095-9238-483213b72fdf req-08d5e42e-e6cb-40c3-9e5d-3964a242b567 service nova] Acquiring lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:40.061190 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9cc6a922-5a0a-4095-9238-483213b72fdf req-08d5e42e-e6cb-40c3-9e5d-3964a242b567 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:40.061416 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9cc6a922-5a0a-4095-9238-483213b72fdf req-08d5e42e-e6cb-40c3-9e5d-3964a242b567 service nova] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:40.061629 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9cc6a922-5a0a-4095-9238-483213b72fdf req-08d5e42e-e6cb-40c3-9e5d-3964a242b567 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] No waiting events found dispatching network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:40.061805 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9cc6a922-5a0a-4095-9238-483213b72fdf req-08d5e42e-e6cb-40c3-9e5d-3964a242b567 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-unplugged-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:47:40.141622 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d422c8cd17d4fe5b548032f10c7c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3020791dcd4ef4b7980dd196a8ca96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:47:40.258553 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:40.508190 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:40.508506 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:40.509075 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Start _get_guest_xml network_info=[{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:54:c9:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue={'image_id': 'ee37cfdf-748a-4fe1-9c51-e737fe3ffa1a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': 'c2f05fbe-de86-4378-8aa5-c047f02ac7b9', 'attached_at': '', 'detached_at': '', 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'serial': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39'}, 'attachment_id': '536b1733-e9c7-4de4-877d-e98a77f142ae', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:40.509241 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'resources' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:40.521317 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Took 1.38 seconds to deallocate network for instance. Jun 09 11:47:40.553732 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:47:40.605396 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004664719999709632 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:40.606331 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:40.606400 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.044857466999929 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:40.606534 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.04471657299996 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:40.607873 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:40.607873 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] VM Stopped (Lifecycle Event) Jun 09 11:47:40.611005 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Successfully created port: 618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:47:41.011084 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:41.013273 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:41.014583 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-718577859', uuid='c2f05fbe-de86-4378-8aa5-c047f02ac7b9'), owner=OwnerMeta(userid='ddbd75a95df64400a7a3db15ee91196e', username='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member', projectid='4b166f86497e4dbfb0ea7e1850584656', projectname='tempest-ServerBootFromVolumeStableRescueTest-252292105'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:54:c9:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005661.014153) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:41.015448 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:41.015782 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:41.016509 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:41.016683 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:41.017633 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:41.017834 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:41.017981 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:41.018055 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:41.018191 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:41.018278 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:41.018388 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:41.018534 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:41.018645 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:41.018775 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:41.018918 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:41.020683 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:41.020683 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:41.030184 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:41.030444 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:41.060919 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:47:41.110124 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ff1edd5e-8b25-4b4c-baa0-9d7da3783f29 None None] [instance: 9e09fd87-2029-4130-9679-3c73b357cfd7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:41.142964 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Successfully updated port: 618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:47:41.522255 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:41.544178 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:41.596406 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b77e33d1-6a80-4ed5-b4f2-a4ee655e345f req-508fce90-830e-42db-96b2-790e39354081 service nova] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Received event network-vif-deleted-5ed2f3a2-a9d6-4f3a-b967-2427b009b18b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:41.625278 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config --force-share --output=json" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:41.628440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:47:41.639423 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:41.639988 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:41.640398 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:41.640631 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:41.641183 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:41.641447 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:41.647610 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:41.647610 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:41.647610 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:41.654670 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:41.666407 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:41.671328 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:41.674313 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:41.674575 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:47:41.682203 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:41.687544 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.687544 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.687544 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.687544 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.687544 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:41.687809 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.687809 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.687809 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.687809 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.687809 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:41.688283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:41.688530 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:41.688946 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('10', '0', '0', 0) found on session 6 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:41.689091 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:41.695455 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.695455 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.695455 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.695455 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.695455 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:41.695630 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.695630 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:41.695630 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.695630 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:41.695630 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:41.695789 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:41.695908 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:41.696255 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('9', '0', '0', 0) found on session 5 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:41.696384 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:41.697930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 6 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:41.698121 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:41.707047 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 5 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:41.707289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:42.075225 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:47:42.077009 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:47:42.079310 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Creating image(s) Jun 09 11:47:42.079821 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "/opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:42.080099 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:42.083281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:42.083281 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:42.084901 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:42.086463 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:42.118540 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Received event network-changed-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:42.118707 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Refreshing instance network info cache due to event network-changed-618aa879-88cc-4085-a5cc-76b96ca1b199. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:42.118906 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] Acquiring lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:42.155944 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.069s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:42.156549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:42.157114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:42.157536 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:42.159860 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:42.160408 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:42.179813 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:47:42.226732 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.066s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:42.226840 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:42.255076 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:47:42.261949 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk 1073741824" returned: 0 in 0.035s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:42.261949 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.105s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:42.262229 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:42.358662 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:42.359120 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:47:42.359369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:42.438755 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:42.439144 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Cannot resize image /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:47:42.439713 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:47:42.440779 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Ensure instance console log exists: /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:47:42.440973 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:42.441296 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:42.441534 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:42.505561 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:42.641842 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:47:42.680159 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updating instance_info_cache with network_info: [{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:42.690412 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.660s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:42.746601 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Deleted allocations for instance dae1d031-f9ec-4441-878d-be97ec49b42f Jun 09 11:47:43.183081 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:43.183081 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Instance network_info: |[{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:47:43.183575 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] Acquired lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:43.185620 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Start _get_guest_xml network_info=[{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:47:43.186057 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Refreshing network info cache for port 618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:43.189706 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:47:43.190962 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='91b55628-1195-485f-910b-bf2d27fd4bd8'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005663.1905937) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:47:43.191811 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:47:43.192204 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:47:43.193036 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:47:43.193260 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:47:43.194161 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:47:43.194530 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:47:43.194676 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:47:43.194807 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:47:43.194975 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:47:43.195085 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:47:43.195218 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:47:43.195452 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:47:43.195594 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:47:43.195729 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:47:43.195853 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:47:43.195983 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:47:43.207684 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=13,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-hwsyhsug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=91b55628-1195-485f-910b-bf2d27fd4bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:43.207902 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:43.208484 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:03:55,bridge_name='br-int',has_traffic_filtering=True,id=618aa879-88cc-4085-a5cc-76b96ca1b199,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618aa879-88') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:43.208952 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'pci_devices' on Instance uuid 91b55628-1195-485f-910b-bf2d27fd4bd8 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:43.622284 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.655567 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Found WWN 33000000058f02a3c for multipath device dm-3 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:47:43.655942 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.028s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:43.656133 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== connect_volume: return (2028ms) {'type': 'block', 'scsi_wwn': '33000000058f02a3c', 'path': '/dev/dm-3', 'multipath_id': '33000000058f02a3c'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:43.656274 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058f02a3c', 'path': '/dev/dm-3', 'multipath_id': '33000000058f02a3c'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:47:43.690030 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] End _get_guest_xml xml= Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 91b55628-1195-485f-910b-bf2d27fd4bd8 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: instance-0000000d Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: multiattach-server-1 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 2026-06-09 11:47:43 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: True Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: bare Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 91b55628-1195-485f-910b-bf2d27fd4bd8 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 91b55628-1195-485f-910b-bf2d27fd4bd8 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: Jun 09 11:47:43.711882 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:43.714411 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Preparing to wait for external event network-vif-plugged-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:47:43.714411 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:43.714411 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:43.714411 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:43.714411 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=13,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-hwsyhsug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=91b55628-1195-485f-910b-bf2d27fd4bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:47:43.714670 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:43.714670 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:03:55,bridge_name='br-int',has_traffic_filtering=True,id=618aa879-88cc-4085-a5cc-76b96ca1b199,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618aa879-88') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:43.714670 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:03:55,bridge_name='br-int',has_traffic_filtering=True,id=618aa879-88cc-4085-a5cc-76b96ca1b199,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618aa879-88') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:47:43.715702 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.715888 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:43.716224 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:47:43.718820 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.718820 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b55d8074-0497-5a2e-a0b4-48bbe4387391', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:43.719427 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.720446 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:43.724714 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.729559 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.729881 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap618aa879-88, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:43.730321 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap618aa879-88, col_values=(('qos', UUID('23d276e4-93c5-4dc8-bb17-f476c686790b')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:43.730611 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap618aa879-88, col_values=(('external_ids', {'iface-id': '618aa879-88cc-4085-a5cc-76b96ca1b199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:03:55', 'vm-uuid': '91b55628-1195-485f-910b-bf2d27fd4bd8'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:47:43.731696 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.733179 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:47:43.741370 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:43.742776 np0000002435 nova-compute[98325]: INFO os_vif [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:03:55,bridge_name='br-int',has_traffic_filtering=True,id=618aa879-88cc-4085-a5cc-76b96ca1b199,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap618aa879-88') Jun 09 11:47:43.763203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9a1dcdc0-b2b2-49e5-bce5-ceb89f7085f8 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Lock "dae1d031-f9ec-4441-878d-be97ec49b42f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.500s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:43.990054 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:44.161042 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718577859',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-718577859',id=11,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:47:32Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-90li3eum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:47:32Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=c2f05fbe-de86-4378-8aa5-c047f02ac7b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:54:c9:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:47:44.161485 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:54:c9:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:47:44.161647 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:47:44.162060 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'pci_devices' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:44.188742 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updated VIF entry in instance network info cache for port 618aa879-88cc-4085-a5cc-76b96ca1b199. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:44.190527 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updating instance_info_cache with network_info: [{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:44.663761 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] End _get_guest_xml xml= Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: instance-0000000b Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 196608 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-server-718577859 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 2026-06-09 11:47:41 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 192 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: True Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: bare Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 0 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: ide Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: pc Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: virtio Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: hvm Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 128 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 1 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: 70e2a824-5ff4-43e3-90b1-eb8fe3827f39 Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: Jun 09 11:47:44.664682 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:47:44.672717 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance destroyed successfully. Jun 09 11:47:44.692516 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b603e283-e3a1-44d1-9ac6-f8dcd5501c10 req-311078ee-2862-4a25-a6a2-d16efc4405fb service nova] Releasing lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:45.263132 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:45.271226 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:45.271405 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:45.271578 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:0e:03:55, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:45.272111 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Using config drive Jun 09 11:47:45.732683 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:45.781161 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:45.900007 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Creating config drive at /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk.config Jun 09 11:47:45.903587 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1l55ts__ {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:45.950379 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1l55ts__" returned: 0 in 0.046s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:46.191287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:46.191287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:46.191287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:46.191287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No VIF found with MAC fa:16:3e:54:c9:62, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:46.191287 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Using config drive Jun 09 11:47:46.429895 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:46.459620 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:46.462339 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:46.538274 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:46.593815 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:46.599878 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:46.624043 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d78e032b-def4-4c0d-bbf0-ed9e54ba77a7 req-04802e82-1b11-46c6-bbcd-f6573b537d44 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Received event network-vif-plugged-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:46.624305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d78e032b-def4-4c0d-bbf0-ed9e54ba77a7 req-04802e82-1b11-46c6-bbcd-f6573b537d44 service nova] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:46.624509 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d78e032b-def4-4c0d-bbf0-ed9e54ba77a7 req-04802e82-1b11-46c6-bbcd-f6573b537d44 service nova] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:46.624682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d78e032b-def4-4c0d-bbf0-ed9e54ba77a7 req-04802e82-1b11-46c6-bbcd-f6573b537d44 service nova] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:46.624850 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d78e032b-def4-4c0d-bbf0-ed9e54ba77a7 req-04802e82-1b11-46c6-bbcd-f6573b537d44 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Processing event network-vif-plugged-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:47:46.695618 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'ec2_ids' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:47.201538 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:47.201652 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'keypairs' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:47.246632 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:47.246796 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] VM Started (Lifecycle Event) Jun 09 11:47:47.247230 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:47:47.251029 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:47:47.253737 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Instance spawned successfully. Jun 09 11:47:47.254017 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:47:47.707876 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:47.710580 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:47.749477 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:47.751194 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:47.759414 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:47.759594 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:47.760006 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:47.760352 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:47.760670 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:47.760978 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:47:47.841028 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Creating config drive at /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config.rescue Jun 09 11:47:47.844670 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkz2sume6 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:47.876029 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkz2sume6" returned: 0 in 0.031s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:48.253857 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:47:48.254461 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:48.254618 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] VM Paused (Lifecycle Event) Jun 09 11:47:48.270235 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Took 6.19 seconds to spawn the instance on the hypervisor. Jun 09 11:47:48.270508 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:48.292360 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.322868 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.327344 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.418752 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.478220 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.481715 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.583233 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f794ae29-b9e7-49fe-b872-a14a545d6c18 req-7d564ec2-a2be-4d44-aff2-c0cd38b57b3a service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:48.585577 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f794ae29-b9e7-49fe-b872-a14a545d6c18 req-7d564ec2-a2be-4d44-aff2-c0cd38b57b3a service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:48.585780 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f794ae29-b9e7-49fe-b872-a14a545d6c18 req-7d564ec2-a2be-4d44-aff2-c0cd38b57b3a service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:48.585819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f794ae29-b9e7-49fe-b872-a14a545d6c18 req-7d564ec2-a2be-4d44-aff2-c0cd38b57b3a service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:48.586144 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f794ae29-b9e7-49fe-b872-a14a545d6c18 req-7d564ec2-a2be-4d44-aff2-c0cd38b57b3a service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:48.586144 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-f794ae29-b9e7-49fe-b872-a14a545d6c18 req-7d564ec2-a2be-4d44-aff2-c0cd38b57b3a service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state rescuing. Jun 09 11:47:48.732926 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:48.745154 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-45e172ea-18e0-46cc-8cb4-433f93ad206f req-d2db05c1-9990-4076-bec2-14ba476cd294 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Received event network-vif-plugged-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:48.745740 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-45e172ea-18e0-46cc-8cb4-433f93ad206f req-d2db05c1-9990-4076-bec2-14ba476cd294 service nova] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:48.745858 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-45e172ea-18e0-46cc-8cb4-433f93ad206f req-d2db05c1-9990-4076-bec2-14ba476cd294 service nova] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:48.745998 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-45e172ea-18e0-46cc-8cb4-433f93ad206f req-d2db05c1-9990-4076-bec2-14ba476cd294 service nova] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:48.746146 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-45e172ea-18e0-46cc-8cb4-433f93ad206f req-d2db05c1-9990-4076-bec2-14ba476cd294 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] No waiting events found dispatching network-vif-plugged-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:48.746314 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-45e172ea-18e0-46cc-8cb4-433f93ad206f req-d2db05c1-9990-4076-bec2-14ba476cd294 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Received unexpected event network-vif-plugged-618aa879-88cc-4085-a5cc-76b96ca1b199 for instance with vm_state active and task_state None. Jun 09 11:47:48.758906 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:48.761013 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:48.761210 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] VM Resumed (Lifecycle Event) Jun 09 11:47:48.801004 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Took 11.92 seconds to build instance. Jun 09 11:47:49.209246 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-674c385e-4721-4df8-a9d1-8661472c32cd tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:49.263660 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:49.266611 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:49.303684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bbfecb8d-83e8-4ed6-8031-a541c44887ed tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.433s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:49.769564 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for c2f05fbe-de86-4378-8aa5-c047f02ac7b9 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:47:49.769564 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:49.769564 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Resumed (Lifecycle Event) Jun 09 11:47:50.161851 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:50.162019 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:50.263872 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:50.271643 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:50.272907 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:50.377668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:50.378042 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:50.574285 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Unrescuing Jun 09 11:47:50.574526 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:50.574752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:50.574928 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:47:50.642384 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6544bdf0-6ac0-4bdf-bc19-55ef303a42e9 req-73175bbe-dfaf-4f37-ac3b-a1e8e33c0528 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:50.642638 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6544bdf0-6ac0-4bdf-bc19-55ef303a42e9 req-73175bbe-dfaf-4f37-ac3b-a1e8e33c0528 service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:50.642793 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6544bdf0-6ac0-4bdf-bc19-55ef303a42e9 req-73175bbe-dfaf-4f37-ac3b-a1e8e33c0528 service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:50.642919 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6544bdf0-6ac0-4bdf-bc19-55ef303a42e9 req-73175bbe-dfaf-4f37-ac3b-a1e8e33c0528 service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:50.643054 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6544bdf0-6ac0-4bdf-bc19-55ef303a42e9 req-73175bbe-dfaf-4f37-ac3b-a1e8e33c0528 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:50.643197 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-6544bdf0-6ac0-4bdf-bc19-55ef303a42e9 req-73175bbe-dfaf-4f37-ac3b-a1e8e33c0528 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state rescued and task_state unrescuing. Jun 09 11:47:50.666835 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lazy-loading 'flavor' on Instance uuid f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:50.775157 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 09 11:47:50.775702 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:50.775702 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Started (Lifecycle Event) Jun 09 11:47:50.881888 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lazy-loading 'flavor' on Instance uuid 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:51.070940 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Received event network-changed-d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:51.071336 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Refreshing instance network info cache due to event network-changed-d2200511-b019-4b9e-8324-38a8181f40ca. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:51.071571 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] Acquiring lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:51.071752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] Acquired lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:51.071931 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Refreshing network info cache for port d2200511-b019-4b9e-8324-38a8181f40ca {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:51.077404 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:51.277689 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:51.283409 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:51.403200 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:51.562891 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Updating instance_info_cache with network_info: [{"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:51.574316 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:51.670935 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:51.784602 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 09 11:47:51.847693 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:51.887639 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:51.970762 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updated VIF entry in instance network info cache for port d2200511-b019-4b9e-8324-38a8181f40ca. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:51.970972 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updating instance_info_cache with network_info: [{"id": "d2200511-b019-4b9e-8324-38a8181f40ca", "address": "fa:16:3e:8e:50:e9", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2200511-b0", "ovs_interfaceid": "d2200511-b019-4b9e-8324-38a8181f40ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:52.065548 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-c2f05fbe-de86-4378-8aa5-c047f02ac7b9" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:52.065970 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'flavor' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:52.472815 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-04770e36-3bb6-46b4-8ea6-692ae51e0a58 req-d02b3c39-cede-4743-935b-b93016c1f819 service nova] Releasing lock "refresh_cache-4b3d0e3a-0700-4b3d-8691-c30a18104acc" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:52.604730 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:52.633468 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:52.652651 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0013551540000662499 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:52.652775 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:52.652871 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.45306419300004563 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:52.653297 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.4529575429999113 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:52.751758 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:52.751758 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:52.776833 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:52.783243 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:52.901896 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99971095900014 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:52.905188 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance destroyed successfully. Jun 09 11:47:52.905536 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'numa_topology' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:53.106597 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005927649999648565 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:53.110699 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-ff1edd5e-8b25-4b4c-baa0-9d7da3783f29 None None] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:53.111172 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-ff1edd5e-8b25-4b4c-baa0-9d7da3783f29 None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] VM Stopped (Lifecycle Event) Jun 09 11:47:53.116038 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:53.116038 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.787949353000158 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:53.116038 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.787763835000078 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:47:53.118949 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:53.118949 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.007s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:53.118949 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Attaching volume 5f14814b-7bf0-4543-bfb4-41ce376afdbd to /dev/sdc Jun 09 11:47:53.162792 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:53.176943 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:47:53.202861 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:53.224577 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:47:53.225454 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:47:53.233389 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:47:53.235844 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355'] Jun 09 11:47:53.235844 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:47:53.235844 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:47:53.235844 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:53.235844 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Updating existing volume attachment record: f68c8261-9d11-4353-8a3f-8193d74cca44 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:47:53.254896 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid 4b3d0e3a-0700-4b3d-8691-c30a18104acc {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:53.333697 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0ceabdbf-649e-41a2-a195-189788e82e83 req-3543bd5b-b125-446d-87a5-555590d82b0c service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:53.333922 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0ceabdbf-649e-41a2-a195-189788e82e83 req-3543bd5b-b125-446d-87a5-555590d82b0c service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:53.335617 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0ceabdbf-649e-41a2-a195-189788e82e83 req-3543bd5b-b125-446d-87a5-555590d82b0c service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:53.335805 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0ceabdbf-649e-41a2-a195-189788e82e83 req-3543bd5b-b125-446d-87a5-555590d82b0c service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:53.335961 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0ceabdbf-649e-41a2-a195-189788e82e83 req-3543bd5b-b125-446d-87a5-555590d82b0c service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:53.336091 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-0ceabdbf-649e-41a2-a195-189788e82e83 req-3543bd5b-b125-446d-87a5-555590d82b0c service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state rescued and task_state unrescuing. Jun 09 11:47:53.360735 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Received event network-changed-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:53.360891 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Refreshing instance network info cache due to event network-changed-618aa879-88cc-4085-a5cc-76b96ca1b199. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:53.361075 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] Acquiring lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:53.361130 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] Acquired lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:53.361301 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Refreshing network info cache for port 618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:53.407642 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:47:53.467282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:53.467282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:53.467282 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Attaching volume 13c7c21c-b38c-47d5-b925-133a9db634f5 to /dev/vdb Jun 09 11:47:53.517148 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:53.527666 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:47:53.546668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:53.572689 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:47:53.573296 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:47:53.581191 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:47:53.582655 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355'] Jun 09 11:47:53.582764 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:47:53.582869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:47:53.583091 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:53.583555 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Updating existing volume attachment record: e50a202e-0414-48c6-b454-b71b4237f473 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:47:53.623944 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ff1edd5e-8b25-4b4c-baa0-9d7da3783f29 None None] [instance: dae1d031-f9ec-4441-878d-be97ec49b42f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:53.743494 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:53.809134 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:47:53.809476 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:53.809617 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:53.810112 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:53.810395 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:47:53.821003 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:53.821672 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:53.822552 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:53.822552 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:53.823006 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:53.823307 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:53.835718 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:53.835718 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:53.842133 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:53.842133 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:53.846087 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd] added Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:53.850289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:53.850579 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:53.850579 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd] added Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:53.860886 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:53.863341 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:53.872642 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:53.874359 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:53.958167 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:54.008535 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:54.010118 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:54.118353 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:54.230981 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:54.262068 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:54.295518 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:47:54.295774 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:54.296339 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:54.378176 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updated VIF entry in instance network info cache for port 618aa879-88cc-4085-a5cc-76b96ca1b199. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:54.378600 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updating instance_info_cache with network_info: [{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:54.631030 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] instance snapshotting Jun 09 11:47:54.634011 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for c2f05fbe-de86-4378-8aa5-c047f02ac7b9 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:47:54.634235 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:54.634663 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Resumed (Lifecycle Event) Jun 09 11:47:54.637970 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-65b70232-4845-4bda-9c02-64cb0f90bcd5 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:54.723803 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Beginning live snapshot process Jun 09 11:47:54.850950 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:54.861560 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.863667 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:54.875461 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:54.880393 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.882997 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e15968af-75e5-403f-950a-312c7f1838c3 req-4bc6c745-970c-4783-bb15-b37e6f67a10b service nova] Releasing lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.888390 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:54.895583 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.910646 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.910646 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.910646 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.910646 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.910646 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:54.910812 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.910812 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.910812 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.910812 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.910812 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:54.923412 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.50.100,3260] Jun 09 11:47:54.923412 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.50.100,3260] successful. Jun 09 11:47:54.923412 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.933600 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.943172 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.40.100,3260] Jun 09 11:47:54.943172 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.40.100,3260] successful. Jun 09 11:47:54.943172 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:54.954829 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:54.957986 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:54.974741 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:54.974741 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.979344 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:54.979605 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:54.979988 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:54.980155 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:54.981008 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:54.981138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:54.997133 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:54.997351 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:55.139555 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:55.140717 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:55.269556 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:55.394025 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:55.394242 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:55.394368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:55.394681 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:55.394797 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:55.394955 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-unplugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state None. Jun 09 11:47:55.395045 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state None. Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] No waiting events found dispatching network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:47:55.398318 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-bef32cbb-2a42-4731-a3ce-ca72e496f1b4 req-b22be785-b9e7-4750-8eb4-9d32abb05a9b service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received unexpected event network-vif-plugged-930eb8bb-2d85-44fe-a9ed-6d0e6885242e for instance with vm_state active and task_state None. Jun 09 11:47:55.644787 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:47:55.644787 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Started (Lifecycle Event) Jun 09 11:47:55.743217 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:55.743668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:55.743963 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Attaching volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 to /dev/vdb Jun 09 11:47:55.799981 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:55.812087 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:47:55.823082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:47:55.835114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:55.859588 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:47:55.859885 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:47:55.870622 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:47:55.873193 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962'] Jun 09 11:47:55.873193 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:47:55.873193 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:47:55.873193 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:55.873193 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Updating existing volume attachment record: 7a4ef28b-1d56-4f29-9708-af0d9122a0a8 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:47:56.147442 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:47:56.150253 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:47:56.238205 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json -f qcow2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:56.315885 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json -f qcow2" returned: 0 in 0.077s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:56.319279 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json -f qcow2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:56.393166 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json -f qcow2" returned: 0 in 0.076s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:56.396483 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:56.398088 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:47:56.398544 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:56.425720 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:47:56.426066 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:47:56.426206 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:56.472469 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.074s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:56.475134 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxaytzqys/b88788685d5d4cc793e4ed25b6c3b7cb.delta 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:56.525341 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxaytzqys/b88788685d5d4cc793e4ed25b6c3b7cb.delta 1073741824" returned: 0 in 0.050s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:56.525980 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Quiescing instance not available: QEMU guest agent is not enabled. Jun 09 11:47:56.788764 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] COPY block job progress, current cursor: 196608 final cursor: 76677120 {{(pid=98325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 09 11:47:56.839456 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Found WWN 330000000d0dd5e38 for multipath device dm-4 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:47:56.841157 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:56.841157 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000d0dd5e38', 'path': '/dev/dm-4', 'multipath_id': '330000000d0dd5e38'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:56.841157 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d0dd5e38', 'path': '/dev/dm-4', 'multipath_id': '330000000d0dd5e38'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:47:56.841430 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.545s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:56.841540 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:47:56.850557 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lazy-loading 'flavor' on Instance uuid f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:56.853550 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:56.854239 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:56.854621 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:56.854922 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:56.855355 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:56.855557 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:56.867526 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:56.867526 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:56.874699 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:56.874699 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5] added Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:56.880830 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:56.881070 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:56.881448 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:56.881524 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5] added Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:56.888707 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:57.147438 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:57.147619 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:57.291351 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 09 11:47:57.292778 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 09 11:47:57.335760 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:47:57.336070 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxaytzqys/b88788685d5d4cc793e4ed25b6c3b7cb.delta /opt/stack/data/nova/instances/snapshots/tmpxaytzqys/b88788685d5d4cc793e4ed25b6c3b7cb {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] attach device xml: Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: 5f14814b-7bf0-4543-bfb4-41ce376afdbd Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]:
Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: Jun 09 11:47:57.364793 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:47:57.547385 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxaytzqys/b88788685d5d4cc793e4ed25b6c3b7cb.delta /opt/stack/data/nova/instances/snapshots/tmpxaytzqys/b88788685d5d4cc793e4ed25b6c3b7cb" returned: 0 in 0.211s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:47:57.553846 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Snapshot extracted, beginning image upload Jun 09 11:47:57.649154 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:47:57.883579 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:57.889360 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:57.894356 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:47:57.901050 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:57.908128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:57.916012 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.929225 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.941860 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:57.942116 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:57.978597 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.40.100,3260] Jun 09 11:47:57.978597 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.40.100,3260] successful. Jun 09 11:47:57.978597 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:57.981679 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:57.983913 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:57.991348 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:58.001835 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.50.100,3260] Jun 09 11:47:58.001835 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.50.100,3260] successful. Jun 09 11:47:58.001835 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.006130 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.006411 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:58.006694 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:58.006796 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:58.007647 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:58.007760 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Scanning host 13 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:58.013763 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:58.025941 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:58.025941 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.033788 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:58.034417 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:47:58.035407 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:47:58.035553 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Scanning host 14 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:47:58.053888 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:47:58.053888 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:47:58.343137 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:58.343537 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:58.346602 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:47:58.346760 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Claim successful on node np0000002435 Jun 09 11:47:58.487544 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'flavor' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:58.759031 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:47:58.766680 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-changed-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:47:58.766821 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Refreshing instance network info cache due to event network-changed-49bd34b5-99d7-4615-9653-01ff6a59c4cf. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:47:58.766991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] Acquiring lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:47:58.767088 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] Acquired lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:47:58.767206 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Refreshing network info cache for port 49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:47:58.857128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:47:59.082124 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No BDM found with device name sda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:59.082279 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:59.082795 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:47:59.083832 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] No VIF found with MAC fa:16:3e:2d:e1:ea, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:47:59.271427 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:59.454576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:47:59.454965 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:47:59.497250 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:47:59.606447 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:47:59.745032 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updated VIF entry in instance network info cache for port 49bd34b5-99d7-4615-9653-01ff6a59c4cf. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:47:59.745470 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updating instance_info_cache with network_info: [{"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:47:59.872849 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Found WWN 3300000005739b5c1 for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:47:59.873769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:47:59.873769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] <== connect_volume: return (5577ms) {'type': 'block', 'scsi_wwn': '3300000005739b5c1', 'path': '/dev/dm-5', 'multipath_id': '3300000005739b5c1'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:47:59.873769 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005739b5c1', 'path': '/dev/dm-5', 'multipath_id': '3300000005739b5c1'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:47:59.873929 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.448s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:59.874156 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:47:59.876122 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lazy-loading 'flavor' on Instance uuid 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:59.889893 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:59.890710 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:47:59.891438 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:59.891905 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:47:59.892204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:47:59.892469 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:47:59.904903 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:59.904903 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:59.908464 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:47:59.908464 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44] added Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:59.918283 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44] added Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:47:59.924229 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:47:59.924771 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:47:59.924771 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:47:59.924771 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:47:59.958428 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'flavor' on Instance uuid 20e2f567-45b9-4beb-b58c-6e62b337525d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:47:59.975523 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:47:59.975718 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:00.247085 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f12591c-4fe8-4d13-ba9e-23afabd8a952 req-a0cac9c4-d4c1-4fdc-bef2-e82bd36ffe18 service nova] Releasing lock "refresh_cache-20e2f567-45b9-4beb-b58c-6e62b337525d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:00.281220 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:00.379484 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Attempting to attach volume 13c7c21c-b38c-47d5-b925-133a9db634f5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] attach device xml: Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: 13c7c21c-b38c-47d5-b925-133a9db634f5 Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: Jun 09 11:48:00.382499 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:00.480232 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:00.561248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:00.561914 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:00.561914 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Attaching volume 075c1506-9b16-45be-880d-540d6f2974c9 to /dev/vdb Jun 09 11:48:00.622107 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:00.632244 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:00.652773 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e1b14122-7424-4195-aa5f-8631e6130774 tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.536s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:00.656285 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:00.680688 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:00.681643 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:00.692232 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:00.693944 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962'] Jun 09 11:48:00.694072 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:00.694181 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:00.694467 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:00.694726 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating existing volume attachment record: 86f42485-959a-4e6a-8066-8a56444c05b6 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:00.843231 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-changed-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:00.843420 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Refreshing instance network info cache due to event network-changed-e8a74c52-55ef-4f12-811a-9909791cf2be. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:00.843682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] Acquiring lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:00.844043 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] Acquired lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:00.844762 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Refreshing network info cache for port e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:00.893793 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Snapshot image upload complete Jun 09 11:48:00.894028 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-c7baf316-0859-4a5d-962b-b35041130f15 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Took 6.26 seconds to snapshot the instance on the hypervisor. Jun 09 11:48:00.916585 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:00.925099 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:00.930401 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:00.940153 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:00.947384 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:00.951524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.961539 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.961800 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:00.967115 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.512s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.968253 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:00.968423 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:00.989946 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.646s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:00.989946 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:48:01.007930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.50.100,3260] Jun 09 11:48:01.007930 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.50.100,3260] successful. Jun 09 11:48:01.007930 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:01.021896 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:01.036845 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.40.100,3260] Jun 09 11:48:01.036845 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.40.100,3260] successful. Jun 09 11:48:01.036845 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.043038 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.043464 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:01.043769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:01.043769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:01.045240 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:01.045398 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:01.050397 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:01.066563 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:01.066563 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.073511 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:01.073754 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:01.073967 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:01.074094 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:01.075141 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:01.075256 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:01.094208 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:01.094509 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:01.259467 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:01.259756 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:01.259866 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:01.347563 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:01.497337 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:48:01.497720 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:48:01.497841 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:01.501332 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:01.606466 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbd75a95df64400a7a3db15ee91196e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b166f86497e4dbfb0ea7e1850584656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:48:01.736367 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:01.844686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:01.844815 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:01.893149 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:01.896590 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Updated VIF entry in instance network info cache for port e8a74c52-55ef-4f12-811a-9909791cf2be. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:01.896925 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Updating instance_info_cache with network_info: [{"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:02.001082 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:48:02.053394 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Successfully created port: f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:48:02.057578 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:02.057656 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:02.057786 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:02.057915 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] No VIF found with MAC fa:16:3e:78:5a:a0, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:02.065426 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:02.065426 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:02.065426 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Attaching volume 62987121-0060-46e6-ae2e-5127db252bc6 to /dev/vdb Jun 09 11:48:02.103439 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:02.118940 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:02.142688 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:02.172209 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:02.172525 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:02.182123 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:02.183797 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962'] Jun 09 11:48:02.184119 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:02.184420 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:02.184668 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:02.184910 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updating existing volume attachment record: 47be50ac-a77b-4256-b210-d14be4dbb280 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:02.348531 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Detaching volume 5f14814b-7bf0-4543-bfb4-41ce376afdbd Jun 09 11:48:02.399090 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c0d18d4f-6c32-489b-877f-2312375de0ce req-454efb59-bdd1-4bdd-a1d7-fba5d59d5bef service nova] Releasing lock "refresh_cache-909cacb1-a84f-45bf-b343-ab2e830208c7" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:02.406203 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Attempting to driver detach volume 5f14814b-7bf0-4543-bfb4-41ce376afdbd from mountpoint /dev/sdc Jun 09 11:48:02.411790 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Found disk sdc by alias ua-5f14814b-7bf0-4543-bfb4-41ce376afdbd {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:02.413896 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Found disk sdc by alias ua-5f14814b-7bf0-4543-bfb4-41ce376afdbd {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:02.414105 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Attempting to detach device sdc from instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] detach device xml: Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: 5f14814b-7bf0-4543-bfb4-41ce376afdbd Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]:
Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: Jun 09 11:48:02.414322 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:02.423758 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Successfully detached device sdc from instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 from the persistent domain config. Jun 09 11:48:02.424117 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] (1/8): Attempting to detach device sdc with device alias ua-5f14814b-7bf0-4543-bfb4-41ce376afdbd from instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] detach device xml: Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: 5f14814b-7bf0-4543-bfb4-41ce376afdbd Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]:
Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: Jun 09 11:48:02.424430 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:02.503950 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:48:02.586755 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:02.587056 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:02.606557 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-5f14814b-7bf0-4543-bfb4-41ce376afdbd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:48:02.607245 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-5f14814b-7bf0-4543-bfb4-41ce376afdbd for instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:48:02.610408 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Successfully detached device sdc from instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 from the live domain config. Jun 09 11:48:02.612385 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:48:02.612641 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:02.612769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:02.628191 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Successfully updated port: f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:48:02.731502 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:02.731764 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:02.731897 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:02.897842 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-changed-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:02.897842 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Refreshing instance network info cache due to event network-changed-f0fa19df-5095-48ad-83e4-18358e1956aa. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:02.897842 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] Acquiring lock "refresh_cache-2974c892-c8d4-41cc-93aa-1c4114c3538b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:02.897842 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] Acquired lock "refresh_cache-2974c892-c8d4-41cc-93aa-1c4114c3538b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:02.897842 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Refreshing network info cache for port f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:02.907144 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000481f206f for multipath device dm-6 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:02.907468 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:02.907613 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (6480ms) {'type': 'block', 'scsi_wwn': '330000000481f206f', 'path': '/dev/dm-6', 'multipath_id': '330000000481f206f'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:02.907757 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000481f206f', 'path': '/dev/dm-6', 'multipath_id': '330000000481f206f'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:02.908482 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.648s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:02.908702 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:02.910803 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid 4b3d0e3a-0700-4b3d-8691-c30a18104acc {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:02.920667 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:02.921285 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:02.921785 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:02.921962 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:02.923186 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:02.923437 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:02.934640 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:02.934640 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:02.938914 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:02.938914 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9] added Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:02.945863 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:02.946055 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:02.946151 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:02.946326 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9] added Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:02.948885 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:02.949027 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:02.949154 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:02.949296 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:03.092143 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'flavor' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:03.131180 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-2974c892-c8d4-41cc-93aa-1c4114c3538b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:03.399995 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:03.413010 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Attempting to attach volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] attach device xml: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: Jun 09 11:48:03.413927 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:03.460232 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:03.513663 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:48:03.514447 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:48:03.514991 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Creating image(s) Jun 09 11:48:03.515048 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "/opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:03.515160 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:03.515549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:03.516029 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:03.518362 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:03.519333 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:03.589575 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:03.589841 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:03.590322 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:03.590727 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:03.592971 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:03.593228 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:03.614385 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-90140578-8c4f-472c-9997-a21e3bf887bd tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.147s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:03.617571 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:03.665018 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.072s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:03.665429 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:03.706719 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk 1073741824" returned: 0 in 0.041s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:03.707382 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.117s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:03.707885 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:03.762959 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:03.777962 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:03.778370 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:48:03.778688 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:03.858954 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:03.859367 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Cannot resize image /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:48:03.859708 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:03.859897 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Ensure instance console log exists: /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:03.860193 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:03.860448 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:03.860668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:03.946947 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:03.949658 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:03.961362 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:03.967343 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:03.975061 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:03.981552 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.991813 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.999204 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:03.999599 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:04.040327 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] Jun 09 11:48:04.040327 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] successful. Jun 09 11:48:04.040327 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:04.045037 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] Jun 09 11:48:04.045037 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] successful. Jun 09 11:48:04.045037 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:04.051528 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:04.058592 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.072355 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:04.072967 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:04.072967 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:04.075278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] HCTL ('17', '-', '-', 0) found on session 13 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:04.075432 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.079705 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:04.080127 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:04.081122 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] HCTL ('18', '-', '-', 0) found on session 14 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:04.081223 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:04.089886 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 13 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:04.089886 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:04.098353 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 14 and hctl ['18', '*', '*', 0] yield: None {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:04.112279 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.525s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:04.134174 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7e52f8c5-08f3-4b6f-8b6d-2ad8929f97c1 req-3ca3f2c0-27bd-4e35-a244-3337fcbdce1e service nova] Releasing lock "refresh_cache-2974c892-c8d4-41cc-93aa-1c4114c3538b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:04.134436 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-2974c892-c8d4-41cc-93aa-1c4114c3538b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:04.134689 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:04.274636 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] volume_snapshot_create: create_info: {'snapshot_id': '1f7d69db-ab53-42be-9ff7-d38946679c1b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98325) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}} Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] snap xml: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: Jun 09 11:48:04.277231 np0000002435 nova-compute[98325]: {{(pid=98325) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}} Jun 09 11:48:04.278055 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] Lazy-loading 'system_metadata' on Instance uuid 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:04.314290 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-d75d4a65-7dde-4d74-89b0-c372e4d1a764 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] volume_snapshot_delete: delete_info: {'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5'} {{(pid=98325) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}} Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [None req-d75d4a65-7dde-4d74-89b0-c372e4d1a764 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Traceback (most recent call last): Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] self._volume_snapshot_delete(context, instance, volume_id, Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] if delete_info['type'] != 'qcow2': Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] ~~~~~~~~~~~^^^^^^^^ Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] KeyError: 'type' Jun 09 11:48:04.317282 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [None req-d75d4a65-7dde-4d74-89b0-c372e4d1a764 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-674b28ec-16d2-4557-8d76-d9b6956ad5a5) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 09 11:48:04.350937 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 09 11:48:04.352349 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server [None req-d75d4a65-7dde-4d74-89b0-c372e4d1a764 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] Exception during message handling: KeyError: 'type' Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server raise self.value Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server raise self.value Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jun 09 11:48:04.359277 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server Jun 09 11:48:04.694631 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:04.780855 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Traceback (most recent call last): Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.788825 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Traceback (most recent call last): Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] self._volume_snapshot_create(context, instance, guest, Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.790051 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1f7d69db-ab53-42be-9ff7-d38946679c1b could not be found. Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1f7d69db-ab53-42be-9ff7-d38946679c1b could not be found. (HTTP 404) (Request-ID: req-1eb31ed7-4d23-47e3-a552-ab4d66bb7940) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 09 11:48:04.817735 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1f7d69db-ab53-42be-9ff7-d38946679c1b could not be found. Jun 09 11:48:04.818731 np0000002435 nova-compute[98325]: ERROR nova.virt.libvirt.driver Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server [None req-0b7bc038-e10d-4c1b-966a-43fb27ce9242 tempest-VolumesAssistedSnapshotsTest-1741174898 tempest-VolumesAssistedSnapshotsTest-1741174898-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server raise self.value Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server raise self.value Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 09 11:48:04.820903 np0000002435 nova-compute[98325]: ERROR oslo_messaging.rpc.server Jun 09 11:48:04.828969 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:04.947995 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Updating instance_info_cache with network_info: [{"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:04.979917 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:04.980104 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:05.071442 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:05.071550 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:05.071637 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:05.071740 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:8e:50:e9, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:05.096845 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 14 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:05.096987 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:05.150780 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:05.150953 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:05.151168 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attaching volume 94429918-165c-47c6-8334-d94b49c43bdd to /dev/vdb Jun 09 11:48:05.183350 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:05.192653 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:05.212177 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:05.234742 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:05.235131 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:05.242936 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:05.244122 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe2d:e1ea', 'fe80::9878:acff:fe87:bfa4', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962'] Jun 09 11:48:05.244223 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:05.244369 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:05.244577 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:05.244834 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating existing volume attachment record: 2618b2b1-3628-403f-a75a-a868276f89c3 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:05.292125 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.450093 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-2974c892-c8d4-41cc-93aa-1c4114c3538b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:05.450508 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Instance network_info: |[{"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:48:05.452304 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Start _get_guest_xml network_info=[{"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:05.454094 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:05.455357 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1320416774', uuid='2974c892-c8d4-41cc-93aa-1c4114c3538b'), owner=OwnerMeta(userid='ddbd75a95df64400a7a3db15ee91196e', username='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member', projectid='4b166f86497e4dbfb0ea7e1850584656', projectname='tempest-ServerBootFromVolumeStableRescueTest-252292105'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005685.4549563) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:05.456184 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:05.456535 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:05.457199 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:05.457398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:05.458210 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:05.458534 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:05.458689 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:05.458804 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:05.458951 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:05.459038 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:05.459166 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:05.459362 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:05.459486 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:05.459629 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:05.459759 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:05.459908 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:05.468897 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1320416774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-1320416774',id=14,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-hl0nxytd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:03Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=2974c892-c8d4-41cc-93aa-1c4114c3538b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:05.469057 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:05.469578 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:05.470062 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'pci_devices' on Instance uuid 2974c892-c8d4-41cc-93aa-1c4114c3538b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:05.482996 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Detaching volume 13c7c21c-b38c-47d5-b925-133a9db634f5 Jun 09 11:48:05.517669 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Attempting to driver detach volume 13c7c21c-b38c-47d5-b925-133a9db634f5 from mountpoint /dev/vdb Jun 09 11:48:05.520405 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Found disk vdb by alias ua-13c7c21c-b38c-47d5-b925-133a9db634f5 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:05.521205 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Found disk vdb by alias ua-13c7c21c-b38c-47d5-b925-133a9db634f5 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:05.521380 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Attempting to detach device vdb from instance 3c6c08b5-e35f-48de-8928-810d426a8122 from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] detach device xml: Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: 13c7c21c-b38c-47d5-b925-133a9db634f5 Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]:
Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: Jun 09 11:48:05.521557 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:05.526543 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Successfully detached device vdb from instance 3c6c08b5-e35f-48de-8928-810d426a8122 from the persistent domain config. Jun 09 11:48:05.526645 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] (1/8): Attempting to detach device vdb with device alias ua-13c7c21c-b38c-47d5-b925-133a9db634f5 from instance 3c6c08b5-e35f-48de-8928-810d426a8122 from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] detach device xml: Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: 13c7c21c-b38c-47d5-b925-133a9db634f5 Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]:
Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: Jun 09 11:48:05.526905 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:05.789871 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:05.790220 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:05.790414 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:05.936383 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Found WWN 330000000e692b5bd for multipath device dm-7 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:05.936751 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:05.937038 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== connect_volume: return (4677ms) {'type': 'block', 'scsi_wwn': '330000000e692b5bd', 'path': '/dev/dm-7', 'multipath_id': '330000000e692b5bd'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:05.937205 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e692b5bd', 'path': '/dev/dm-7', 'multipath_id': '330000000e692b5bd'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:05.937580 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.325s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:05.937843 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f14814b-7bf0-4543-bfb4-41ce376afdbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:48:05.937963 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:48:05.939920 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'flavor' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:05.966317 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:05.966610 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', '9')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:48:05.966935 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', '8')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:05.968486 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd', '7')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:05.969400 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Resulting device map defaultdict(. at 0x77d8e065a840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'): ({'sdf'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:48:05.969678 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Removing multipathed devices sdg, sdf {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:48:05.970721 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Flush multipath device 330000000d0dd5e38 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] End _get_guest_xml xml= Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 2974c892-c8d4-41cc-93aa-1c4114c3538b Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: instance-0000000e Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-server-1320416774 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 2026-06-09 11:48:05 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: True Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: bare Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 2974c892-c8d4-41cc-93aa-1c4114c3538b Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 2974c892-c8d4-41cc-93aa-1c4114c3538b Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: Jun 09 11:48:05.973367 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:05.975522 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Preparing to wait for external event network-vif-plugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:05.975522 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:05.975522 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:05.975522 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:05.975522 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1320416774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-1320416774',id=14,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-hl0nxytd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:03Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=2974c892-c8d4-41cc-93aa-1c4114c3538b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:05.975745 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:05.975745 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:05.975745 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:05.975869 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.976147 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:05.976376 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:05.977778 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.978023 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c984251-c444-58de-b6b4-573c34936efa', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:05.978631 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.979250 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:05.980076 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.981572 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.981757 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0fa19df-50, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:05.982100 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0fa19df-50, col_values=(('qos', UUID('3fbadc46-02c5-437f-975b-9fc2835ac4e1')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:05.982283 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0fa19df-50, col_values=(('external_ids', {'iface-id': 'f0fa19df-5095-48ad-83e4-18358e1956aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8e:25', 'vm-uuid': '2974c892-c8d4-41cc-93aa-1c4114c3538b'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:05.983427 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.984925 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:05.989116 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:05.990079 np0000002435 nova-compute[98325]: INFO os_vif [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') Jun 09 11:48:05.992625 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-13c7c21c-b38c-47d5-b925-133a9db634f5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:48:05.993718 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-13c7c21c-b38c-47d5-b925-133a9db634f5 for instance 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:48:05.996210 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Successfully detached device vdb from instance 3c6c08b5-e35f-48de-8928-810d426a8122 from the live domain config. Jun 09 11:48:05.997154 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:48:05.998584 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:05.998920 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:06.000056 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:06.058828 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:06.108054 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:48:06.108254 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:48:06.109855 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:48:06.121886 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:48:06.121886 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:48:06.132439 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.170079 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.40.100,3260] Jun 09 11:48:06.170079 np0000002435 nova-compute[98325]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.40.100,3260] successful. Jun 09 11:48:06.170079 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.188376 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.198088 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.233492 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.50.100,3260] Jun 09 11:48:06.233492 np0000002435 nova-compute[98325]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-5f14814b-7bf0-4543-bfb4-41ce376afdbd, portal: 192.168.50.100,3260] successful. Jun 09 11:48:06.233492 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.250733 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.250975 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:06.251122 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] <== disconnect_volume: return (3638ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:06.251290 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:48:06.251852 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.520s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:06.252094 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:06.264104 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:06.264542 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:06.264888 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:06.265052 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:06.265401 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:06.265564 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:06.275641 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:06.275641 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.279958 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:06.279958 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6] added Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:06.286690 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.286857 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:06.287109 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:06.287228 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6] added Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:06.289220 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:06.289479 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:06.289532 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:06.289675 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:06.352174 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:06.352360 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:06.445357 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Attempting to attach volume 075c1506-9b16-45be-880d-540d6f2974c9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] attach device xml: Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: 075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: Jun 09 11:48:06.446397 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:06.625124 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a893ba88-fc65-4b3d-bcb3-83ddfe26c530 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.882s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:06.804047 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lazy-loading 'flavor' on Instance uuid f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:06.855676 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid 91b55628-1195-485f-910b-bf2d27fd4bd8 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:07.287631 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:07.289952 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:07.299714 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:07.303207 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.313416 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.320952 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.331666 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.332129 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.339933 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.340236 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:07.384777 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.50.100,3260] Jun 09 11:48:07.384777 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.50.100,3260] successful. Jun 09 11:48:07.384777 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.394992 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.398456 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.40.100,3260] Jun 09 11:48:07.398456 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.40.100,3260] successful. Jun 09 11:48:07.398456 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.411595 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.415004 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:07.415451 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:07.415884 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:07.416765 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] HCTL ('11', '-', '-', 0) found on session 15 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:07.416919 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:07.430986 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching for a device in session 15 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:07.430986 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.434103 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:07.434439 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:07.434748 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:07.435591 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] HCTL ('12', '-', '-', 0) found on session 16 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:07.435697 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:07.449915 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching for a device in session 16 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:07.450159 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:07.505650 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:07.505762 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:07.505886 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No VIF found with MAC fa:16:3e:84:8e:25, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:07.506254 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Using config drive Jun 09 11:48:07.781760 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:07.814985 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-edc372cd-ad42-4cea-b860-ec6e2dd0ccae tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.970s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:07.860001 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.507s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:07.902048 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00042690099985520646 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:07.902173 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:08.011179 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:08.101957 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:08.102070 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:08.102176 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:08.102282 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No VIF found with MAC fa:16:3e:33:f9:9d, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:08.137439 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Creating config drive at /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk.config Jun 09 11:48:08.141249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4hvdoq96 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:08.190904 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4hvdoq96" returned: 0 in 0.049s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:08.266073 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:08.399304 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:08.399576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:08.399812 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:08.400197 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:08.400197 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:08.403155 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Terminating instance Jun 09 11:48:08.609434 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.634278 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.746382 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.759410 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.760772 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.861775 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-69fac675-4b10-47ca-9595-393d02ee5d9e req-b5aa89ab-d6b9-4cfd-8356-904cf0aedb34 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-plugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:08.863029 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-69fac675-4b10-47ca-9595-393d02ee5d9e req-b5aa89ab-d6b9-4cfd-8356-904cf0aedb34 service nova] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:08.863184 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-69fac675-4b10-47ca-9595-393d02ee5d9e req-b5aa89ab-d6b9-4cfd-8356-904cf0aedb34 service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:08.863326 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-69fac675-4b10-47ca-9595-393d02ee5d9e req-b5aa89ab-d6b9-4cfd-8356-904cf0aedb34 service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:08.863453 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-69fac675-4b10-47ca-9595-393d02ee5d9e req-b5aa89ab-d6b9-4cfd-8356-904cf0aedb34 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Processing event network-vif-plugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:48:08.907536 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:48:08.924955 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.943280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:08.943280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:08.943280 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Attaching volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 to /dev/vdb Jun 09 11:48:08.949439 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.954462 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.973986 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:08.977453 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.002011 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:09.017967 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:09.038166 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:09.063280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:09.063581 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:09.071511 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:09.073069 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25'] Jun 09 11:48:09.073225 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:09.073320 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:09.073550 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:09.073770 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updating existing volume attachment record: c58177c0-8027-40af-8ee8-55d03adcfdb2 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:09.229363 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999542102000078 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:09.229906 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998947877999854 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:09.230007 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998812914999917 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:09.230481 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Instance destroyed successfully. Jun 09 11:48:09.230993 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lazy-loading 'resources' on Instance uuid f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:09.288494 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Found WWN 3300000003794021f for multipath device dm-4 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:09.288931 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:09.289377 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] <== connect_volume: return (6557ms) {'type': 'block', 'scsi_wwn': '3300000003794021f', 'path': '/dev/dm-4', 'multipath_id': '3300000003794021f'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:09.289554 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003794021f', 'path': '/dev/dm-4', 'multipath_id': '3300000003794021f'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:09.290468 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.500s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:09.291658 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:09.292780 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'flavor' on Instance uuid 20e2f567-45b9-4beb-b58c-6e62b337525d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:09.306117 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:09.306599 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:09.306844 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:09.307451 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:09.308118 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:09.308403 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:09.320437 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:09.320437 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:09.322524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:09.322524 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd] added Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:09.333224 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:09.333469 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:09.333592 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:09.334232 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd] added Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:09.337416 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:09.337702 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:09.337702 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:09.337814 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:09.425158 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.460401 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:09.460799 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:48:09.460943 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] VM Started (Lifecycle Event) Jun 09 11:48:09.462942 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:48:09.464480 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Instance spawned successfully. Jun 09 11:48:09.464743 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:48:09.628736 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:09.629070 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:09.629278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:09.673292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-7b752f41-dfd9-4579-a055-fa42a25d6471 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.112s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:09.738938 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1913696064',display_name='tempest-AttachSCSIVolumeTestJSON-server-1913696064',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachscsivolumetestjson-server-1913696064',id=6,image_ref='b097d1db-8ac6-47f3-8a86-f232bf287cf0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4gG+NC8hGGUk04qbFEgxxvKkgUp0/BL5Xrx9Rh/c+qYEP8AxWzRGA6yV5vmHlgNONftQfrDold+cK6Hbd3neq50qSHWpGnjCOVv17RGhjaVKeWFpJ6vapaKOPHmnx4CQ==',key_name='tempest-keypair-900619453',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:09Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a68e42f95c184ecab12e38e66deeb515',ramdisk_id='',reservation_id='r-2x8i7vlm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b097d1db-8ac6-47f3-8a86-f232bf287cf0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-164304252',owner_user_name='tempest-AttachSCSIVolumeTestJSON-164304252-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e0a2a4b6104128bfc54c2c9083fee2',uuid=f9e4069d-81e1-4c41-9f3b-3e0ea9756c05,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:09.740448 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Converting VIF {"id": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "address": "fa:16:3e:2d:e1:ea", "network": {"id": "c7c29058-db5b-47d7-9b08-d6b95851231a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-300831743-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a68e42f95c184ecab12e38e66deeb515", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c770421-8b", "ovs_interfaceid": "0c770421-8b9b-4ee3-959c-0f0a85cedc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:09.740448 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:09.740448 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:09.741329 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.741509 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c770421-8b, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:09.755622 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.756580 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:09.757856 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.758037 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=397ccbbd-0c6b-4dae-a71d-5e5f38bfe470) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:09.758500 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.758939 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:09.759429 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:09.761866 np0000002435 nova-compute[98325]: INFO os_vif [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=0c770421-8b9b-4ee3-959c-0f0a85cedc6b,network=Network(c7c29058-db5b-47d7-9b08-d6b95851231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c770421-8b') Jun 09 11:48:09.762189 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Deleting instance files /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05_del Jun 09 11:48:09.762995 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Deletion of /opt/stack/data/nova/instances/f9e4069d-81e1-4c41-9f3b-3e0ea9756c05_del complete Jun 09 11:48:09.797191 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Attempting to attach volume 62987121-0060-46e6-ae2e-5127db252bc6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] attach device xml: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: Jun 09 11:48:09.798429 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:09.963610 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:09.967452 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:09.974855 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:09.975649 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:09.976129 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:09.976455 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:09.976816 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:09.977210 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:10.017139 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-eaa21f65-7b36-4a70-8320-973c7a5e0369 req-757a54b2-fd6c-4d29-a46b-87b6fef44151 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-vif-unplugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:10.017379 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-eaa21f65-7b36-4a70-8320-973c7a5e0369 req-757a54b2-fd6c-4d29-a46b-87b6fef44151 service nova] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:10.017526 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-eaa21f65-7b36-4a70-8320-973c7a5e0369 req-757a54b2-fd6c-4d29-a46b-87b6fef44151 service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:10.017677 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-eaa21f65-7b36-4a70-8320-973c7a5e0369 req-757a54b2-fd6c-4d29-a46b-87b6fef44151 service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:10.017776 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-eaa21f65-7b36-4a70-8320-973c7a5e0369 req-757a54b2-fd6c-4d29-a46b-87b6fef44151 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] No waiting events found dispatching network-vif-unplugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:10.017898 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-eaa21f65-7b36-4a70-8320-973c7a5e0369 req-757a54b2-fd6c-4d29-a46b-87b6fef44151 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-vif-unplugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:10.270478 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Took 1.36 seconds to destroy the instance on the hypervisor. Jun 09 11:48:10.271449 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:48:10.271744 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:48:10.272745 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:48:10.272745 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:10.293765 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:10.337374 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:10.339211 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:10.339542 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:10.354463 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:10.356674 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.368558 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.374441 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.392502 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.399670 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.400284 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:10.462319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.40.100,3260] Jun 09 11:48:10.462319 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.40.100,3260] successful. Jun 09 11:48:10.462319 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.470240 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.50.100,3260] Jun 09 11:48:10.470240 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.50.100,3260] successful. Jun 09 11:48:10.470240 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.471027 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:10.471454 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:10.471906 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] VM Paused (Lifecycle Event) Jun 09 11:48:10.482420 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Took 6.97 seconds to spawn the instance on the hypervisor. Jun 09 11:48:10.482587 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:10.483756 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.493754 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.512337 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:10.512705 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:10.512998 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:10.514180 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:10.515586 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.516992 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:10.517289 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:10.517972 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:10.517972 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:10.521293 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:10.521424 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:10.542746 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:10.542746 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:10.542746 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:10.542746 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:10.958509 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0b8b1dbd-0941-4c5f-becf-74a1a2d87407 req-0f3b0717-b8b0-42ca-824a-2ff9f4187213 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-plugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:10.958653 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0b8b1dbd-0941-4c5f-becf-74a1a2d87407 req-0f3b0717-b8b0-42ca-824a-2ff9f4187213 service nova] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:10.958854 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0b8b1dbd-0941-4c5f-becf-74a1a2d87407 req-0f3b0717-b8b0-42ca-824a-2ff9f4187213 service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:10.958953 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0b8b1dbd-0941-4c5f-becf-74a1a2d87407 req-0f3b0717-b8b0-42ca-824a-2ff9f4187213 service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:10.959011 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0b8b1dbd-0941-4c5f-becf-74a1a2d87407 req-0f3b0717-b8b0-42ca-824a-2ff9f4187213 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] No waiting events found dispatching network-vif-plugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:10.959134 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-0b8b1dbd-0941-4c5f-becf-74a1a2d87407 req-0f3b0717-b8b0-42ca-824a-2ff9f4187213 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received unexpected event network-vif-plugged-f0fa19df-5095-48ad-83e4-18358e1956aa for instance with vm_state active and task_state None. Jun 09 11:48:10.975573 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:10.977493 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:10.977493 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] VM Resumed (Lifecycle Event) Jun 09 11:48:10.996800 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Took 12.84 seconds to build instance. Jun 09 11:48:11.309435 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:11.462351 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:11.462478 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:11.462554 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:11.462655 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No VIF found with MAC fa:16:3e:2d:5b:bd, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:11.483943 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:11.485462 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:11.487816 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:11.499546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-bd22ef81-7e02-4806-b08c-f9d4d3101376 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.352s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:11.986914 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Took 1.71 seconds to deallocate network for instance. Jun 09 11:48:12.080587 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-vif-unplugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:12.080775 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] Acquiring lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:12.080844 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:12.081020 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:12.081065 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] No waiting events found dispatching network-vif-unplugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:12.081224 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received unexpected event network-vif-unplugged-0c770421-8b9b-4ee3-959c-0f0a85cedc6b for instance with vm_state deleted and task_state None. Jun 09 11:48:12.081359 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f592bea7-cfb7-4d5e-b42e-78bb4ce46ad3 req-672c15a7-bfd6-4148-b966-b12da3b97c06 service nova] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Received event network-vif-deleted-0c770421-8b9b-4ee3-959c-0f0a85cedc6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:12.328524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Found WWN 33000000039069334 for multipath device dm-8 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:12.328990 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:12.329575 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] <== connect_volume: return (6538ms) {'type': 'block', 'scsi_wwn': '33000000039069334', 'path': '/dev/dm-8', 'multipath_id': '33000000039069334'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:12.329765 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000039069334', 'path': '/dev/dm-8', 'multipath_id': '33000000039069334'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:12.330439 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.331s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:12.330929 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13c7c21c-b38c-47d5-b925-133a9db634f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:48:12.331205 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:48:12.334688 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'flavor' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:12.371552 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5 (non-flash) Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:12.371916 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', '9')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:48:12.372423 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', '9')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:12.373879 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5', '10')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:12.375166 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Resulting device map defaultdict(. at 0x77d8e03f49a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'): ({'sdi'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:48:12.375413 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Removing multipathed devices sdi, sdh {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:48:12.375639 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Flush multipath device 3300000005739b5c1 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:48:12.411757 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:12.459963 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:12.505709 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:12.509861 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:48:12.509861 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:48:12.510297 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:12.514583 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:48:12.529022 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:48:12.529189 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:48:12.545577 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.595701 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.40.100,3260] Jun 09 11:48:12.595701 np0000002435 nova-compute[98325]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.40.100,3260] successful. Jun 09 11:48:12.595701 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.624194 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.637509 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.683433 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.50.100,3260] Jun 09 11:48:12.683433 np0000002435 nova-compute[98325]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-13c7c21c-b38c-47d5-b925-133a9db634f5, portal: 192.168.50.100,3260] successful. Jun 09 11:48:12.683433 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.708297 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.708681 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:12.708992 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] <== disconnect_volume: return (6710ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:12.709114 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:48:12.709682 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.080s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:12.709682 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:12.726565 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:12.727174 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:12.728517 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:12.728737 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:12.729278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:12.729545 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:12.744445 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:12.750794 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.758181 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.766150 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.778075 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:12.778497 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:12.778934 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:12.779392 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('15', '0', '0', 0) found on session 11 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:12.779499 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.789535 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:12.790057 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:12.790605 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:12.790605 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 11 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:12.790718 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:12.791677 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('16', '0', '0', 0) found on session 12 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:12.791830 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:12.800848 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 12 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:12.801046 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:12.841198 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attempting to attach volume 94429918-165c-47c6-8334-d94b49c43bdd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] attach device xml: Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: 94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: Jun 09 11:48:12.841980 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:13.008774 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:13.029205 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f50981bd-a034-4d08-a690-d24535cabd2f tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.963s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:13.118097 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:13.186806 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:13.186806 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:13.289712 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lazy-loading 'flavor' on Instance uuid 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:13.328303 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Stashing vm_state: active {{(pid=98325) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 09 11:48:13.524812 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:13.525948 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:13.528597 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] instance snapshotting Jun 09 11:48:13.631271 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Beginning live snapshot process Jun 09 11:48:13.688717 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:13.728662 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:13.879313 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:14.031917 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'flavor' on Instance uuid 909cacb1-a84f-45bf-b343-ab2e830208c7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:14.195754 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.686s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:14.197221 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.318s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:14.256248 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Deleted allocations for instance f9e4069d-81e1-4c41-9f3b-3e0ea9756c05 Jun 09 11:48:14.294665 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dd026f1c-4d0c-4fb9-a5e9-eca9740ba5a2 tempest-VolumesAssistedSnapshotsTest-1105766599 tempest-VolumesAssistedSnapshotsTest-1105766599-project-admin] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 9.314s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:14.519087 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:14.519286 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:14.519434 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:14.519563 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No VIF found with MAC fa:16:3e:d0:5a:d3, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:14.706797 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:48:14.707253 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Claim successful on node np0000002435 Jun 09 11:48:14.747015 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000481f206f for multipath device dm-6 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:14.747331 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.038s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:14.747486 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (5117ms) {'type': 'block', 'scsi_wwn': '330000000481f206f', 'path': '/dev/dm-6', 'multipath_id': '330000000481f206f'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:14.747590 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000481f206f', 'path': '/dev/dm-6', 'multipath_id': '330000000481f206f'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:14.750429 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid 91b55628-1195-485f-910b-bf2d27fd4bd8 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:14.761503 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:15.040330 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:15.148865 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json -f qcow2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:15.215755 np0000002435 nova-compute[98325]: INFO nova.compute.resource_tracker [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating resource usage from migration 2d8719ec-f4bd-4e20-b985-f4d7b8544ccb Jun 09 11:48:15.233336 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json -f qcow2" returned: 0 in 0.086s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:15.233511 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json -f qcow2 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:15.260516 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Attempting to attach volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:15.275032 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8f8e5fd6-fded-4571-af1c-f19446fe160c tempest-AttachSCSIVolumeTestJSON-164304252 tempest-AttachSCSIVolumeTestJSON-164304252-project-member] Lock "f9e4069d-81e1-4c41-9f3b-3e0ea9756c05" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.875s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] attach device xml: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: Jun 09 11:48:15.277210 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:15.295987 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:15.320548 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json -f qcow2" returned: 0 in 0.087s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:15.321288 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:15.323892 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:15.325643 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:15.395280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.071s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:15.396078 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsw8x703_/0e641d470f414171a714e64e1317c26a.delta 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:15.447592 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsw8x703_/0e641d470f414171a714e64e1317c26a.delta 1073741824" returned: 0 in 0.052s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:15.448087 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Quiescing instance not available: QEMU guest agent is not enabled. Jun 09 11:48:15.722594 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98325) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 09 11:48:15.725742 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 09 11:48:15.763226 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:48:15.763565 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsw8x703_/0e641d470f414171a714e64e1317c26a.delta /opt/stack/data/nova/instances/snapshots/tmpsw8x703_/0e641d470f414171a714e64e1317c26a {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:15.789745 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:15.790654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.010s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:15.792195 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:15.792439 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:15.792715 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:15.801709 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Terminating instance Jun 09 11:48:15.862403 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsw8x703_/0e641d470f414171a714e64e1317c26a.delta /opt/stack/data/nova/instances/snapshots/tmpsw8x703_/0e641d470f414171a714e64e1317c26a" returned: 0 in 0.099s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:15.862985 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Snapshot extracted, beginning image upload Jun 09 11:48:15.986245 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:15.986572 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:16.083387 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a48fbf03-723c-4146-a440-b9d04b27f3e4 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.932s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:16.136287 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:16.136520 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:16.136751 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Attaching volume 62987121-0060-46e6-ae2e-5127db252bc6 to /dev/vdb Jun 09 11:48:16.191118 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:16.207973 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:16.231917 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:16.257130 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:16.257400 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:16.265100 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:16.267863 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::9413:f5ff:fe9e:1010', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe33:f99d', 'fe80::88fb:cbff:fe45:b3a9', 'fe80::fc16:3eff:fe78:5aa0', 'fe80::5c92:89ff:fefd:590b', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25'] Jun 09 11:48:16.267996 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:16.268103 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:16.268361 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:16.268661 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Updating existing volume attachment record: 16300fdd-fcab-4a20-847a-4f1bc9cefef4 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:16.311129 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:48:16.364950 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.394957 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.404342 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.433310 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.466306 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.483650 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.489376 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:16.573478 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-017fbf25-4e9d-4ca3-9109-e0b60009000e req-e3cfc722-2d46-4ce1-9d15-d7fa62bb85b7 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-unplugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:16.573942 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-017fbf25-4e9d-4ca3-9109-e0b60009000e req-e3cfc722-2d46-4ce1-9d15-d7fa62bb85b7 service nova] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:16.574133 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-017fbf25-4e9d-4ca3-9109-e0b60009000e req-e3cfc722-2d46-4ce1-9d15-d7fa62bb85b7 service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:16.574251 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-017fbf25-4e9d-4ca3-9109-e0b60009000e req-e3cfc722-2d46-4ce1-9d15-d7fa62bb85b7 service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:16.574404 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-017fbf25-4e9d-4ca3-9109-e0b60009000e req-e3cfc722-2d46-4ce1-9d15-d7fa62bb85b7 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] No waiting events found dispatching network-vif-unplugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:16.574533 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-017fbf25-4e9d-4ca3-9109-e0b60009000e req-e3cfc722-2d46-4ce1-9d15-d7fa62bb85b7 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-unplugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:16.637337 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.647330 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:16.669955 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999702762000197 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:16.675223 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Instance destroyed successfully. Jun 09 11:48:16.675651 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lazy-loading 'resources' on Instance uuid 3c6c08b5-e35f-48de-8928-810d426a8122 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:16.827050 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:16.827457 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:16.827628 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:16.828020 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:16.828230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:16.846564 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:16.847444 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:16.848179 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:16.848561 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:16.849021 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:16.849095 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:16.865116 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:16.872946 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:16.880226 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:16.887784 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.910057 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.910704 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:16.913524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:16.913524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:16.913524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] HCTL ('12', '0', '0', 0) found on session 16 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:16.913775 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.921968 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:16.922781 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:16.923496 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] HCTL ('11', '0', '0', 0) found on session 15 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:16.923496 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:16.924312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching for a device in session 16 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:16.924451 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:16.938104 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Searching for a device in session 15 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:16.938104 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:16.947295 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:16.947767 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:16.947940 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:16.948140 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:0e:03:55, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:16.996158 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.799s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:16.996451 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Migrating Jun 09 11:48:16.996651 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:16.996771 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:17.178486 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-210691191',display_name='tempest-VolumesAssistedSnapshotsTest-server-210691191',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesassistedsnapshotstest-server-210691191',id=7,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtfXaPovHIEtRHyYj6BuTxTNB0g/qRqujIuEvzb3Mdh3HKJNugcCOl0eBKL3Oo+BZN6pfsRVtCXong1PHH8m4Xqji1am8wIjYlKqJdu/1eYhUL8WxIq1lLBChNC3NInzA==',key_name='tempest-keypair-979541135',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:12Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='94c0b97f88c340218d8db8e1e6e13187',ramdisk_id='',reservation_id='r-z7l00w4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1055922968',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1055922968-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='537da7f83e7a4deb8bc755cf2eedfd26',uuid=3c6c08b5-e35f-48de-8928-810d426a8122,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:17.179018 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Converting VIF {"id": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "address": "fa:16:3e:78:5a:a0", "network": {"id": "cb191888-7eea-44b2-85e3-398d8ca7b012", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-25256422-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94c0b97f88c340218d8db8e1e6e13187", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf464bce-a7", "ovs_interfaceid": "df464bce-a7f9-41c4-9aa2-ce240dc07d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:17.179304 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:17.179548 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:17.180912 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:17.181114 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf464bce-a7, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:17.182498 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:17.183200 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:17.184009 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:17.187322 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:17.187499 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdb11503-41ec-4869-a498-eeaae1b30f09) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:17.189396 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:17.190097 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:17.193486 np0000002435 nova-compute[98325]: INFO os_vif [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:5a:a0,bridge_name='br-int',has_traffic_filtering=True,id=df464bce-a7f9-41c4-9aa2-ce240dc07d47,network=Network(cb191888-7eea-44b2-85e3-398d8ca7b012),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf464bce-a7') Jun 09 11:48:17.193905 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Deleting instance files /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122_del Jun 09 11:48:17.194728 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Deletion of /opt/stack/data/nova/instances/3c6c08b5-e35f-48de-8928-810d426a8122_del complete Jun 09 11:48:17.409141 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Rescuing Jun 09 11:48:17.409335 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:17.409439 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:17.409543 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:17.498840 np0000002435 nova-compute[98325]: INFO nova.compute.rpcapi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jun 09 11:48:17.499621 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:17.499929 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:48:17.706072 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Took 1.39 seconds to destroy the instance on the hypervisor. Jun 09 11:48:17.706991 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:48:17.707366 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:48:17.707504 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:48:17.707978 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:17.806061 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:17.851101 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:17.912899 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:18.031569 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:18.031736 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:18.031886 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:18.327294 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:18.423913 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-24ac41f8-ab3e-4d50-a506-25da74d7bec4 req-6e1b4654-f759-4f0c-b22e-76e139da8294 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-deleted-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:18.423977 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-24ac41f8-ab3e-4d50-a506-25da74d7bec4 req-6e1b4654-f759-4f0c-b22e-76e139da8294 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Neutron deleted interface df464bce-a7f9-41c4-9aa2-ce240dc07d47; detaching it from the instance and deleting it from the info cache Jun 09 11:48:18.425638 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-24ac41f8-ab3e-4d50-a506-25da74d7bec4 req-6e1b4654-f759-4f0c-b22e-76e139da8294 service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Detach interface failed, port_id=df464bce-a7f9-41c4-9aa2-ce240dc07d47, reason: Instance 3c6c08b5-e35f-48de-8928-810d426a8122 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:48:18.458784 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:18.459009 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:18.506379 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:18.509113 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-98f325ed-4b87-4ca3-863f-28222255c269 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.566s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:18.533826 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:18.663700 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c6b4d05c-cfdc-4c58-aa0b-b3804f863ebc req-9d572eda-607c-4859-b011-b75d7dc6409c service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-unplugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:18.663869 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c6b4d05c-cfdc-4c58-aa0b-b3804f863ebc req-9d572eda-607c-4859-b011-b75d7dc6409c service nova] Acquiring lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:18.664171 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c6b4d05c-cfdc-4c58-aa0b-b3804f863ebc req-9d572eda-607c-4859-b011-b75d7dc6409c service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:18.664586 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c6b4d05c-cfdc-4c58-aa0b-b3804f863ebc req-9d572eda-607c-4859-b011-b75d7dc6409c service nova] Lock "3c6c08b5-e35f-48de-8928-810d426a8122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:18.664586 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c6b4d05c-cfdc-4c58-aa0b-b3804f863ebc req-9d572eda-607c-4859-b011-b75d7dc6409c service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] No waiting events found dispatching network-vif-unplugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:18.664740 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c6b4d05c-cfdc-4c58-aa0b-b3804f863ebc req-9d572eda-607c-4859-b011-b75d7dc6409c service nova] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Received event network-vif-unplugged-df464bce-a7f9-41c4-9aa2-ce240dc07d47 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:18.857357 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:18.873890 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Found WWN 3300000003794021f for multipath device dm-4 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:18.874283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:18.874517 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '3300000003794021f', 'path': '/dev/dm-4', 'multipath_id': '3300000003794021f'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:18.874689 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003794021f', 'path': '/dev/dm-4', 'multipath_id': '3300000003794021f'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:18.878196 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'flavor' on Instance uuid 909cacb1-a84f-45bf-b343-ab2e830208c7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:18.932213 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:18.961157 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:48:19.004407 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Snapshot image upload complete Jun 09 11:48:19.004697 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-acfc80f3-6ac6-44ad-8a6f-a6eda7f0be6d tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Took 5.47 seconds to snapshot the instance on the hypervisor. Jun 09 11:48:19.014894 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:19.132609 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:19.134329 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:19.334805 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:19.335465 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:19.359888 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Took 1.65 seconds to deallocate network for instance. Jun 09 11:48:19.383631 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Attempting to attach volume 62987121-0060-46e6-ae2e-5127db252bc6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] attach device xml: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: Jun 09 11:48:19.384802 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:48:19.540810 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:19.541084 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:19.546299 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:48:19.546632 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Claim successful on node np0000002435 Jun 09 11:48:19.637546 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:19.846094 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Detaching volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:19.869708 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:19.887958 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 4b3d0e3a-0700-4b3d-8691-c30a18104acc] Attempting to driver detach volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 from mountpoint /dev/vdb Jun 09 11:48:19.893920 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:19.898778 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:19.898982 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Attempting to detach device vdb from instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]:
Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: Jun 09 11:48:19.899287 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:19.907300 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc from the persistent domain config. Jun 09 11:48:19.908704 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] (1/8): Attempting to detach device vdb with device alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 from instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]:
Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: Jun 09 11:48:19.909239 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:20.314368 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.406917 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:48:20.407962 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 for instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:48:20.410254 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc from the live domain config. Jun 09 11:48:20.649036 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.652360 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.676860 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.679190 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.710657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.846508 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:20.846695 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:20.936433 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.941974 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Detected multiple connections on this host for volume: ae72a9df-bc98-4e27-8d9c-16ea53762d44, skipping target disconnect. Jun 09 11:48:20.948471 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:20.977220 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99950930099999 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:20.982293 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance destroyed successfully. Jun 09 11:48:20.982293 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'numa_topology' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:21.072787 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:21.072975 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:21.073210 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:21.073372 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] No VIF found with MAC fa:16:3e:89:eb:33, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:21.157158 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Starting migrate_disk_and_power_off {{(pid=98325) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12626}} Jun 09 11:48:21.268381 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.272526 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.289934 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.300416 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.337425 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.352149 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:48:21.440825 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:21.441437 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:21.487501 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attempting a stable device rescue Jun 09 11:48:21.535541 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid 4b3d0e3a-0700-4b3d-8691-c30a18104acc {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:21.540417 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e207d9aa-a34c-442a-b33d-f16960a10b84 req-d17b4254-7f04-4015-80ac-e79c26492009 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:21.540646 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e207d9aa-a34c-442a-b33d-f16960a10b84 req-d17b4254-7f04-4015-80ac-e79c26492009 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:21.540838 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e207d9aa-a34c-442a-b33d-f16960a10b84 req-d17b4254-7f04-4015-80ac-e79c26492009 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:21.540985 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e207d9aa-a34c-442a-b33d-f16960a10b84 req-d17b4254-7f04-4015-80ac-e79c26492009 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:21.543292 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e207d9aa-a34c-442a-b33d-f16960a10b84 req-d17b4254-7f04-4015-80ac-e79c26492009 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:21.543292 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-e207d9aa-a34c-442a-b33d-f16960a10b84 req-d17b4254-7f04-4015-80ac-e79c26492009 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state active and task_state resize_migrating. Jun 09 11:48:21.557917 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99970482599997 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:21.558626 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance destroyed successfully. Jun 09 11:48:21.560022 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:17Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:21.560345 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:21.561037 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:21.561500 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:21.563520 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.563756 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc607e9-d1, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:21.566400 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:21.572009 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.573525 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.573776 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a84ec1b3-329c-41bb-a29e-37d7ac9cae7e) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:21.575503 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:21.583438 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:21.585232 np0000002435 nova-compute[98325]: INFO os_vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') Jun 09 11:48:21.590944 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:48:21.591734 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:21.591891 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:21.592342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:21.592652 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:48:21.592768 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:48:21.643870 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:21.645146 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:21.645668 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:21.645972 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:48:21.645972 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '13')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:21.647806 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '14')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:21.648700 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:48:21.648899 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Creating image(s) Jun 09 11:48:21.649994 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:21.650289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:21.651117 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:21.651388 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'trusted_certs' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:21.653612 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Resulting device map defaultdict(. at 0x77d8e06b1b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'): ({'sdm'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:48:21.655020 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Removing multipathed devices sdm, sdl {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:48:21.655326 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flush multipath device 330000000e692b5bd {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:48:21.691072 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:21.733876 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:21.770659 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:48:21.770847 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:48:21.771959 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:48:21.782341 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:48:21.782544 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:48:21.799852 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:21.845705 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] Jun 09 11:48:21.845705 np0000002435 nova-compute[98325]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] successful. Jun 09 11:48:21.845705 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:21.878169 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:21.892619 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:21.914782 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:21.941196 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] Jun 09 11:48:21.941196 np0000002435 nova-compute[98325]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] successful. Jun 09 11:48:21.941196 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:21.943814 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:21.954622 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9e0f3af0-ab7f-420c-bb33-f32682093d73 req-ec037d72-d723-441f-88f2-2ef0f8584f36 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:21.957215 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9e0f3af0-ab7f-420c-bb33-f32682093d73 req-ec037d72-d723-441f-88f2-2ef0f8584f36 service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:21.958197 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9e0f3af0-ab7f-420c-bb33-f32682093d73 req-ec037d72-d723-441f-88f2-2ef0f8584f36 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:21.958400 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9e0f3af0-ab7f-420c-bb33-f32682093d73 req-ec037d72-d723-441f-88f2-2ef0f8584f36 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:21.958590 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9e0f3af0-ab7f-420c-bb33-f32682093d73 req-ec037d72-d723-441f-88f2-2ef0f8584f36 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:21.958753 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9e0f3af0-ab7f-420c-bb33-f32682093d73 req-ec037d72-d723-441f-88f2-2ef0f8584f36 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state active and task_state rescuing. Jun 09 11:48:21.966926 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:21.967177 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:21.967357 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== disconnect_volume: return (375ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:21.967529 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:48:21.970382 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:22.061367 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:22.065480 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:22.152145 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:22.152682 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:48:22.153646 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:22.154591 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_resize/disk /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:22.154967 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "460c238bf48fab86c05a2a82dc5f42073a7fe285" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:22.168167 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "460c238bf48fab86c05a2a82dc5f42073a7fe285" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.013s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:22.245756 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_resize/disk /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk" returned: 0 in 0.091s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:22.247242 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_resize/disk.config /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:22.274353 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_resize/disk.config /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config" returned: 0 in 0.028s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:22.274687 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_resize/disk.info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:22.302625 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_resize/disk.info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" returned: 0 in 0.027s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:22.454315 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.913s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:22.455100 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:48:22.458951 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.589s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:22.552061 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1ffc56df-d19b-45c9-a85c-e1d2d2bf0344 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "4b3d0e3a-0700-4b3d-8691-c30a18104acc" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.217s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:22.653540 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf47b678-7ac6-4198-82af-0e57cbf77a70 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.516s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:22.844508 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "91b55628-1195-485f-910b-bf2d27fd4bd8" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:22.845410 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:22.965699 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:48:22.966131 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:48:22.966474 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:22.966713 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:23.066321 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82b0c4212f2a4e4e8c057324dbd2ff17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442924f56f0d49859aaa6ff4af8d78c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:48:23.305963 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:23.306203 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:23.352012 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Detaching volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:23.415251 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Attempting to driver detach volume ae72a9df-bc98-4e27-8d9c-16ea53762d44 from mountpoint /dev/vdb Jun 09 11:48:23.418814 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:23.420521 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Attempting to detach device vdb from instance 91b55628-1195-485f-910b-bf2d27fd4bd8 from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]:
Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: Jun 09 11:48:23.420942 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:23.428651 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance 91b55628-1195-485f-910b-bf2d27fd4bd8 from the persistent domain config. Jun 09 11:48:23.428804 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] (1/8): Attempting to detach device vdb with device alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 from instance 91b55628-1195-485f-910b-bf2d27fd4bd8 from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: ae72a9df-bc98-4e27-8d9c-16ea53762d44 Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]:
Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: Jun 09 11:48:23.429321 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:23.463826 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:23.469905 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:23.472152 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:48:23.474295 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:23.488962 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:23.489919 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:23.560382 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.part --force-share --output=json" returned: 0 in 0.086s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:23.561006 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] c64f2a25-f9dc-485b-8255-a970ca150f6a was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:48:23.561970 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:48:23.562359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.part /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:23.597827 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Port dfc607e9-d1c6-474b-b876-d24787b0e300 binding to destination host np0000002435 is already ACTIVE {{(pid=98325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 09 11:48:23.607699 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Successfully created port: fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:48:23.612253 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:23.612560 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:23.670691 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5515f703-a7ee-4e13-a6d9-b3d484baad1d req-1ba14a04-8777-4274-946e-5c6085e6fdba service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:23.670691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5515f703-a7ee-4e13-a6d9-b3d484baad1d req-1ba14a04-8777-4274-946e-5c6085e6fdba service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:23.670691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5515f703-a7ee-4e13-a6d9-b3d484baad1d req-1ba14a04-8777-4274-946e-5c6085e6fdba service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:23.670880 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5515f703-a7ee-4e13-a6d9-b3d484baad1d req-1ba14a04-8777-4274-946e-5c6085e6fdba service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:23.670880 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5515f703-a7ee-4e13-a6d9-b3d484baad1d req-1ba14a04-8777-4274-946e-5c6085e6fdba service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:23.670975 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5515f703-a7ee-4e13-a6d9-b3d484baad1d req-1ba14a04-8777-4274-946e-5c6085e6fdba service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state active and task_state resize_migrating. Jun 09 11:48:23.724748 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.part /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.converted" returned: 0 in 0.162s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:23.739150 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:23.809975 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:23.817078 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.817416 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.817582 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.818135 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.818135 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.818202 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.818479 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.818641 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.818773 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:48:23.818903 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:48:23.826691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285.converted --force-share --output=json" returned: 0 in 0.086s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:23.826691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "460c238bf48fab86c05a2a82dc5f42073a7fe285" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.658s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:23.826691 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:23.830458 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:23.831770 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "460c238bf48fab86c05a2a82dc5f42073a7fe285" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:23.832595 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "460c238bf48fab86c05a2a82dc5f42073a7fe285" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:23.832595 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:23.836404 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:23.837189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:23.918368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285 --force-share --output=json" returned: 0 in 0.081s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:23.918817 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285,backing_fmt=raw /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.rescue {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:23.958926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/460c238bf48fab86c05a2a82dc5f42073a7fe285,backing_fmt=raw /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.rescue" returned: 0 in 0.040s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:23.960659 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "460c238bf48fab86c05a2a82dc5f42073a7fe285" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.127s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:23.960659 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'migration_context' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:23.998200 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:48:24.022300 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-be5d90f7-6f7a-4c69-8633-d8c4a07eec55 req-89c9389f-9c9b-49c4-9e3f-83d5fae72d7b service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:24.022471 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-be5d90f7-6f7a-4c69-8633-d8c4a07eec55 req-89c9389f-9c9b-49c4-9e3f-83d5fae72d7b service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:24.022717 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-be5d90f7-6f7a-4c69-8633-d8c4a07eec55 req-89c9389f-9c9b-49c4-9e3f-83d5fae72d7b service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:24.023256 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-be5d90f7-6f7a-4c69-8633-d8c4a07eec55 req-89c9389f-9c9b-49c4-9e3f-83d5fae72d7b service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:24.023512 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-be5d90f7-6f7a-4c69-8633-d8c4a07eec55 req-89c9389f-9c9b-49c4-9e3f-83d5fae72d7b service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:24.023703 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-be5d90f7-6f7a-4c69-8633-d8c4a07eec55 req-89c9389f-9c9b-49c4-9e3f-83d5fae72d7b service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state active and task_state rescuing. Jun 09 11:48:24.111231 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Successfully updated port: fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:48:24.115629 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Detaching volume 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:24.167755 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Attempting to driver detach volume 62987121-0060-46e6-ae2e-5127db252bc6 from mountpoint /dev/vdb Jun 09 11:48:24.170779 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Found disk vdb by alias ua-62987121-0060-46e6-ae2e-5127db252bc6 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:24.172042 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Found disk vdb by alias ua-62987121-0060-46e6-ae2e-5127db252bc6 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:24.172215 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Attempting to detach device vdb from instance 909cacb1-a84f-45bf-b343-ab2e830208c7 from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] detach device xml: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]:
Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: Jun 09 11:48:24.172527 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:24.178935 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully detached device vdb from instance 909cacb1-a84f-45bf-b343-ab2e830208c7 from the persistent domain config. Jun 09 11:48:24.179113 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] (1/8): Attempting to detach device vdb with device alias ua-62987121-0060-46e6-ae2e-5127db252bc6 from instance 909cacb1-a84f-45bf-b343-ab2e830208c7 from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] detach device xml: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]:
Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: Jun 09 11:48:24.179415 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:24.229540 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006835409999439435 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:24.230490 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:24.230490 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:24.230601 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] VM Stopped (Lifecycle Event) Jun 09 11:48:24.231757 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.437930622000067 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:24.231812 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.437818471000128 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:24.318593 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.860s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:24.320147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.404s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:24.324088 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:48:24.324242 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Claim successful on node np0000002435 Jun 09 11:48:24.327860 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:24.380881 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Deleted allocations for instance 3c6c08b5-e35f-48de-8928-810d426a8122 Jun 09 11:48:24.463412 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:24.464712 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:24.465703 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Start _get_guest_xml network_info=[{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "vif_mac": "fa:16:3e:d0:5a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue={'image_id': 'c64f2a25-f9dc-485b-8255-a970ca150f6a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, 'status': 'reserved', 'instance': 'f973e06e-5d44-4393-abce-509f80f2db62', 'attached_at': '', 'detached_at': '', 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'serial': '94429918-165c-47c6-8334-d94b49c43bdd'}, 'attachment_id': '2618b2b1-3628-403f-a75a-a868276f89c3', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:24.465891 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'resources' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:24.610576 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:48:24.616843 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "refresh_cache-687bfd28-5f09-4036-b557-dd324ab1cc6e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:24.617115 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquired lock "refresh_cache-687bfd28-5f09-4036-b557-dd324ab1cc6e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:24.617237 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:24.626641 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:24.626889 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:24.627109 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:24.733405 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5afdc77b-ec33-4c10-9be1-bcef151fdcf3 tempest-ServersNegativeTestJSON-2084585060 tempest-ServersNegativeTestJSON-2084585060-project-member] [instance: f9e4069d-81e1-4c41-9f3b-3e0ea9756c05] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:24.790919 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-62987121-0060-46e6-ae2e-5127db252bc6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:48:24.797083 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-62987121-0060-46e6-ae2e-5127db252bc6 for instance 909cacb1-a84f-45bf-b343-ab2e830208c7 {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:48:24.802315 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully detached device vdb from instance 909cacb1-a84f-45bf-b343-ab2e830208c7 from the live domain config. Jun 09 11:48:24.968628 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:24.970673 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:24.972677 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1777809667', uuid='f973e06e-5d44-4393-abce-509f80f2db62'), owner=OwnerMeta(userid='35bde36378d547078d9410928ae16735', username='tempest-ServerStableDeviceRescueTest-1966995700-project-member', projectid='97413552cb514828acbb1e9f9de02eda', projectname='tempest-ServerStableDeviceRescueTest-1966995700'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "vif_mac": "fa:16:3e:d0:5a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005704.971568) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:24.977538 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:24.977866 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:24.978764 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:24.978951 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:24.980107 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:24.980445 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:24.981497 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:24.982766 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:24.982949 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:24.983078 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:24.983228 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:24.983416 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:24.983548 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:24.983711 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:24.983870 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:24.984058 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:24.984245 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'vcpu_model' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:25.008204 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:48:25.009320 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:48:25.009573 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Creating image(s) Jun 09 11:48:25.010147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "/opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:25.010521 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "/opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:25.011418 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "/opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:25.012046 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:25.014785 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:25.015955 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:25.091293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.075s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:25.092065 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:25.092065 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:25.092470 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:25.095580 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:25.095671 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:25.179586 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.084s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:25.180008 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:25.194288 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:25.229387 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk 1073741824" returned: 0 in 0.049s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:25.229811 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.138s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:25.230225 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:25.306384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.076s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:25.307275 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:48:25.307508 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:25.319003 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:25.354141 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Detected multiple connections on this host for volume: 62987121-0060-46e6-ae2e-5127db252bc6, skipping target disconnect. Jun 09 11:48:25.380274 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:25.388139 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:25.393564 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Cannot resize image /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:48:25.393861 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:25.394010 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Ensure instance console log exists: /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:25.395644 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-67e0a504-5ab0-4c20-8d52-f8b3cdf370cc tempest-VolumesAssistedSnapshotsTest-1055922968 tempest-VolumesAssistedSnapshotsTest-1055922968-project-member] Lock "3c6c08b5-e35f-48de-8928-810d426a8122" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.604s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:25.395756 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:25.396084 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:25.396211 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:25.487459 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:25.499158 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:25.568218 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Updating instance_info_cache with network_info: [{"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:25.594700 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:25.595593 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:25.595832 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:25.597035 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "/opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:25.597392 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:25.597756 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:25.597890 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:25.598203 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:25.598503 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:25.612592 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:25.613308 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:25.613764 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:25.613990 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:25.614555 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:25.614815 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:25.625473 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:25.631882 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:25.639256 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:25.641327 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:25.647325 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.658996 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.659326 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:25.659514 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:25.659514 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:25.660038 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] HCTL ('19', '0', '0', 0) found on session 17 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:25.660148 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:25.668366 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching for a device in session 17 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:25.668457 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.669074 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:25.669286 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:25.669512 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:25.669625 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:25.670219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] HCTL ('20', '0', '0', 0) found on session 18 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:25.670342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:25.678006 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Searching for a device in session 18 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:25.678192 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:25.747522 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:25.747689 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:25.747842 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:25.933365 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'flavor' on Instance uuid 909cacb1-a84f-45bf-b343-ab2e830208c7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:26.070701 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Releasing lock "refresh_cache-687bfd28-5f09-4036-b557-dd324ab1cc6e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:26.071350 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Instance network_info: |[{"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:48:26.073105 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Start _get_guest_xml network_info=[{"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:26.080725 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:26.081901 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-454680300', uuid='687bfd28-5f09-4036-b557-dd324ab1cc6e'), owner=OwnerMeta(userid='82b0c4212f2a4e4e8c057324dbd2ff17', username='tempest-VolumesActionsTest-339598293-project-member', projectid='442924f56f0d49859aaa6ff4af8d78c0', projectname='tempest-VolumesActionsTest-339598293'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005706.0815785) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:26.084235 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:26.084770 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:26.085771 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:26.085981 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:26.087159 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:26.087487 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:26.087627 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:26.087718 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:26.087850 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:26.088394 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:26.088501 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:26.088647 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:26.089336 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:26.089442 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:26.089517 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:26.089646 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:26.105171 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-changed-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:26.105377 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Refreshing instance network info cache due to event network-changed-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:26.105744 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] Acquiring lock "refresh_cache-687bfd28-5f09-4036-b557-dd324ab1cc6e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:26.105882 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] Acquired lock "refresh_cache-687bfd28-5f09-4036-b557-dd324ab1cc6e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:26.106007 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Refreshing network info cache for port fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:26.110659 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-454680300',display_name='tempest-VolumesActionsTest-instance-454680300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesactionstest-instance-454680300',id=15,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='442924f56f0d49859aaa6ff4af8d78c0',ramdisk_id='',reservation_id='r-5ylm0qzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-339598293',owner_user_name='tempest-VolumesActionsTest-339598293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:24Z,user_data=None,user_id='82b0c4212f2a4e4e8c057324dbd2ff17',uuid=687bfd28-5f09-4036-b557-dd324ab1cc6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:26.110822 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Converting VIF {"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:26.111658 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:26.112943 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:26.113242 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:26.114958 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lazy-loading 'pci_devices' on Instance uuid 687bfd28-5f09-4036-b557-dd324ab1cc6e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:26.249776 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:26.283447 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.499038 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:48:26.499720 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ae72a9df-bc98-4e27-8d9c-16ea53762d44 for instance 91b55628-1195-485f-910b-bf2d27fd4bd8 {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:48:26.502553 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance 91b55628-1195-485f-910b-bf2d27fd4bd8 from the live domain config. Jun 09 11:48:26.545602 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:48:26.545866 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:26.545980 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:26.574955 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.602093 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:26.609061 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:26.614284 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:26.616855 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] End _get_guest_xml xml= Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 687bfd28-5f09-4036-b557-dd324ab1cc6e Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: instance-0000000f Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: tempest-VolumesActionsTest-instance-454680300 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 2026-06-09 11:48:26 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: True Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: bare Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: tempest-VolumesActionsTest-339598293-project-member Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: tempest-VolumesActionsTest-339598293 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 687bfd28-5f09-4036-b557-dd324ab1cc6e Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 687bfd28-5f09-4036-b557-dd324ab1cc6e Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: Jun 09 11:48:26.622874 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:26.625457 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Preparing to wait for external event network-vif-plugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:26.625457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:26.625457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:26.625457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:26.625457 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-454680300',display_name='tempest-VolumesActionsTest-instance-454680300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesactionstest-instance-454680300',id=15,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='442924f56f0d49859aaa6ff4af8d78c0',ramdisk_id='',reservation_id='r-5ylm0qzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-339598293',owner_user_name='tempest-VolumesActionsTest-339598293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:24Z,user_data=None,user_id='82b0c4212f2a4e4e8c057324dbd2ff17',uuid=687bfd28-5f09-4036-b557-dd324ab1cc6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:26.625690 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Converting VIF {"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:26.625767 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:26.626734 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:26.626734 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.626734 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:26.626971 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:26.628365 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.628536 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80fcf17b-4ab5-5998-b794-a432e269ede1', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:26.630346 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:26.635354 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.637635 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.637923 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbaf38b8-0e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:26.638593 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbaf38b8-0e, col_values=(('qos', UUID('18d97ede-ef00-4fb1-8216-ef77e39707d1')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:26.638682 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbaf38b8-0e, col_values=(('external_ids', {'iface-id': 'fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:a2:bd', 'vm-uuid': '687bfd28-5f09-4036-b557-dd324ab1cc6e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:26.639725 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.641180 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:26.652535 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:26.653578 np0000002435 nova-compute[98325]: INFO os_vif [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') Jun 09 11:48:26.761492 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:26.939035 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dd2bd988-7494-42fc-a4ec-f27d97f1435b tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.326s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:26.950564 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:27.117685 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Updated VIF entry in instance network info cache for port fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:27.117685 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Updating instance_info_cache with network_info: [{"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:27.129914 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.811s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:27.130037 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:48:27.132681 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.805s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:27.132896 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:27.133073 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:48:27.263653 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:27.362160 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:27.620873 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-461ad486-a832-4f5f-a73a-3cf446e758a0 req-c5c19eae-038f-4f2a-848e-4fa0f0e91a3e service nova] Releasing lock "refresh_cache-687bfd28-5f09-4036-b557-dd324ab1cc6e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:27.633433 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Found WWN 33000000039069334 for multipath device dm-8 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:27.633433 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:27.633433 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '33000000039069334', 'path': '/dev/dm-8', 'multipath_id': '33000000039069334'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:27.633433 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000039069334', 'path': '/dev/dm-8', 'multipath_id': '33000000039069334'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:27.634032 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.088s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:27.634352 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ae72a9df-bc98-4e27-8d9c-16ea53762d44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:48:27.634519 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:48:27.641480 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:48:27.641480 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:48:27.641705 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:27.641994 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:27.664532 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:27.664804 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:48:27.665034 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '12')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:27.665929 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44', '11')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:27.670440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Resulting device map defaultdict(. at 0x77d8e06b3100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'): ({'sdj'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:48:27.670620 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Removing multipathed devices sdj, sdk {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:48:27.672660 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flush multipath device 330000000481f206f {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:48:27.706138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:27.754845 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbd75a95df64400a7a3db15ee91196e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b166f86497e4dbfb0ea7e1850584656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:48:27.770613 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:27.772640 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:27.783883 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:27.807932 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:27.823820 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:48:27.824976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:48:27.826871 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:48:27.838931 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:48:27.839415 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:48:27.843776 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:27.844376 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:27.851611 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:27.857535 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:27.858736 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25'] Jun 09 11:48:27.858866 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:27.858997 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:27.859239 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:27.898360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.40.100,3260] Jun 09 11:48:27.898360 np0000002435 nova-compute[98325]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.40.100,3260] successful. Jun 09 11:48:27.898360 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:27.923325 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:27.937898 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:27.982656 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.50.100,3260] Jun 09 11:48:27.982656 np0000002435 nova-compute[98325]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-ae72a9df-bc98-4e27-8d9c-16ea53762d44, portal: 192.168.50.100,3260] successful. Jun 09 11:48:27.982656 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:27.994844 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:27.995050 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:28.001663 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:28.002040 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:28.002229 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== disconnect_volume: return (1456ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:28.002532 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:48:28.142470 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:48:28.150000 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1777809667',display_name='tempest-ServerStableDeviceRescueTest-server-1777809667',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverstabledevicerescuetest-server-1777809667',id=3,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJog5LRUAJnLmramI+tIZTLsBkK1S9u9VYhQUeQnru8fu1pzGmBeKQpQnutdjX4MSEKGyJSOMEFot91cm+xXvwnMDRWoriySF2F/yPHgLWnjp5o5PnYp+pq7xgFFTt/cw==',key_name='tempest-keypair-895276484',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:12Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='97413552cb514828acbb1e9f9de02eda',ramdisk_id='',reservation_id='r-ax4xbky3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1966995700',owner_user_name='tempest-ServerStableDeviceRescueTest-1966995700-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35bde36378d547078d9410928ae16735',uuid=f973e06e-5d44-4393-abce-509f80f2db62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "vif_mac": "fa:16:3e:d0:5a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:28.151787 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converting VIF {"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "vif_mac": "fa:16:3e:d0:5a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:28.151787 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:28.153003 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'pci_devices' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:28.167966 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.186497 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:28.186735 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:28.186817 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] No VIF found with MAC fa:16:3e:c2:a2:bd, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:28.188039 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Using config drive Jun 09 11:48:28.249995 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.250641 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.277463 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:28.326558 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.327063 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:48:28.329958 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:48:28.331359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.425038 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.425890 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.500286 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Detaching volume 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:28.532702 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.533093 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:48:28.535777 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.558079 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Attempting to driver detach volume 62987121-0060-46e6-ae2e-5127db252bc6 from mountpoint /dev/vdb Jun 09 11:48:28.565390 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid 91b55628-1195-485f-910b-bf2d27fd4bd8 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:28.570598 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Found disk vdb by alias ua-62987121-0060-46e6-ae2e-5127db252bc6 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:28.571686 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Found disk vdb by alias ua-62987121-0060-46e6-ae2e-5127db252bc6 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:48:28.571834 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Attempting to detach device vdb from instance 20e2f567-45b9-4beb-b58c-6e62b337525d from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] detach device xml: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]:
Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: Jun 09 11:48:28.572228 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:28.579620 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully detached device vdb from instance 20e2f567-45b9-4beb-b58c-6e62b337525d from the persistent domain config. Jun 09 11:48:28.579940 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] (1/8): Attempting to detach device vdb with device alias ua-62987121-0060-46e6-ae2e-5127db252bc6 from instance 20e2f567-45b9-4beb-b58c-6e62b337525d from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] detach device xml: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: 62987121-0060-46e6-ae2e-5127db252bc6 Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]:
Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: Jun 09 11:48:28.580300 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:48:28.587747 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Successfully created port: 128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:48:28.633882 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.634348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.651468 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:48:28.658972 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] End _get_guest_xml xml= Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: instance-00000003 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: tempest-ServerStableDeviceRescueTest-server-1777809667 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 2026-06-09 11:48:24 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: True Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: bare Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: ide Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: pc Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: tempest-ServerStableDeviceRescueTest-1966995700-project-member Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: tempest-ServerStableDeviceRescueTest-1966995700 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: 94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: Jun 09 11:48:28.661565 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:28.677234 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance destroyed successfully. Jun 09 11:48:28.698980 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:28.741670 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.742560 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:48:28.749329 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.838344 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.841395 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:28.918987 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:28.924394 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.007472 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.007949 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.041138 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Starting finish_migration {{(pid=98325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12813}} Jun 09 11:48:29.042749 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:48:29.042797 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Creating image(s) Jun 09 11:48:29.043643 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.090371 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.091127 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000000f, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.config' Jun 09 11:48:29.095644 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.133365 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.089s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.133758 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:48:29.133995 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.169210 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Booting with volume-backed-image b8dcd603-8bb0-4f2a-bfa2-115620ecccb4 at /dev/vda Jun 09 11:48:29.177298 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.177794 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.213707 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.214101 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Cannot resize image /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:48:29.254525 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.257981 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:48:29.261930 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.355752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.356408 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.444768 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Successfully updated port: 128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:48:29.447462 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.452085 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.514191 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-changed-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:29.514191 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Refreshing instance network info cache due to event network-changed-128e9294-0996-449b-a826-33c4bb2d14e2. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:29.514191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] Acquiring lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:29.514191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] Acquired lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:29.514191 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Refreshing network info cache for port 128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:29.551334 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.551503 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.579672 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-2a101cdc-6884-4788-ade3-b6eefbb4a98a tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "91b55628-1195-485f-910b-bf2d27fd4bd8" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.734s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:29.580961 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:29.602036 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Creating config drive at /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.config Jun 09 11:48:29.608608 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy2r1g3k1 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.649522 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.653412 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.664203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy2r1g3k1" returned: 0 in 0.055s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.719328 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:48:29.719763 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Ensure instance console log exists: /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:29.720461 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:29.720712 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:29.720838 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:29.726291 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start _get_guest_xml network_info=[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c5797bda-6c93-417f-be59-a3c76be89e7e', 'attached_at': '2026-06-09T11:48:28.000000', 'detached_at': '', 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'serial': '075c1506-9b16-45be-880d-540d6f2974c9'}, 'attachment_id': 'bc94997c-2ada-4818-9a73-06ee6bda03c8', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:29.734354 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:29.735704 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1443682971', uuid='c5797bda-6c93-417f-be59-a3c76be89e7e'), owner=OwnerMeta(userid='ddafbf9dd6d14df9aa70526de4ceade9', username='tempest-ServerActionsTestOtherB-436431080-project-member', projectid='ef6342a70d63478b87507cf6ab897736', projectname='tempest-ServerActionsTestOtherB-436431080'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005709.735346) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:29.739529 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:29.739863 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:29.740685 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:29.740850 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:29.741846 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:29.742158 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:29.742491 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:29.742600 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:29.742714 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:29.742793 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:29.742885 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:29.743028 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:29.743158 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:29.743370 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:29.743477 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:29.743581 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:29.750433 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.751318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.772863 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.835601 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.842580 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:29.843794 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:29.868858 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.871055 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:29.872246 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:29.872369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:29.872897 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:29.873537 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:29.873766 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:29.874216 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:29.874592 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:29.878582 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.035s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:29.879054 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=12407MB free_disk=74.17987442016602GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:48:29.879249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:29.879547 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:29.887770 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:29.892050 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:29.897448 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:29.898417 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:29.898710 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:29.899206 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:29.913220 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:29.913220 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:29.923387 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:29.923387 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9] added Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:29.926804 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:29.926984 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:29.927428 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:29.927576 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9] added Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:29.936801 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:29.937039 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:29.937319 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:29.937536 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:29.948592 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:30.019231 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:30.109329 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:30.169360 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.200510 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.206631 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.209570 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:30.209570 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:30.209570 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:30.209757 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:30.209757 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] No VIF found with MAC fa:16:3e:d0:5a:d3, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:30.210388 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Using config drive Jun 09 11:48:30.301904 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.315072 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:30.318614 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.541494 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.549660 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.568047 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.619246 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-62987121-0060-46e6-ae2e-5127db252bc6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:48:30.622322 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-62987121-0060-46e6-ae2e-5127db252bc6 for instance 20e2f567-45b9-4beb-b58c-6e62b337525d {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:48:30.627325 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully detached device vdb from instance 20e2f567-45b9-4beb-b58c-6e62b337525d from the live domain config. Jun 09 11:48:30.672601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:48:30.672601 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:30.672601 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:30.707219 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.712933 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'ec2_ids' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:30.725932 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:30.819892 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7cb5360c-1730-4bdd-a083-47af8200d01e req-954709c5-dcbe-4cc5-9d6c-80a129b721a6 service nova] Releasing lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:30.820944 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:30.820944 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:30.904968 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Applying migration context for instance c5797bda-6c93-417f-be59-a3c76be89e7e as it has an incoming, in-progress migration 2d8719ec-f4bd-4e20-b985-f4d7b8544ccb. Migration status is post-migrating {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 09 11:48:30.907333 np0000002435 nova-compute[98325]: INFO nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating resource usage from migration 2d8719ec-f4bd-4e20-b985-f4d7b8544ccb Jun 09 11:48:30.928047 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:30.937932 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:30.939994 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:30.951294 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:30.957465 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:30.963122 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 54835fc7-b0b9-4113-90ad-797bdac45590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.963288 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance f973e06e-5d44-4393-abce-509f80f2db62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.963419 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.963862 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 909cacb1-a84f-45bf-b343-ab2e830208c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964027 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 20e2f567-45b9-4beb-b58c-6e62b337525d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964297 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance c2f05fbe-de86-4378-8aa5-c047f02ac7b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964424 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964520 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 91b55628-1195-485f-910b-bf2d27fd4bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964609 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 2974c892-c8d4-41cc-93aa-1c4114c3538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964699 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Migration 2d8719ec-f4bd-4e20-b985-f4d7b8544ccb is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 09 11:48:30.964788 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance c5797bda-6c93-417f-be59-a3c76be89e7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.964870 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 687bfd28-5f09-4036-b557-dd324ab1cc6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.965384 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance bac006c2-baff-4c37-8d24-8d4799d6583b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:48:30.965780 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:48:30.965999 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=3072MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:48:29 up 31 min, 2 users, load average: 7.69, 3.81, 1.74\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '8', 'num_os_type_None': '12', 'num_proj_4b166f86497e4dbfb0ea7e1850584656': '4', 'io_workload': '3', 'num_task_rescuing': '1', 'num_proj_97413552cb514828acbb1e9f9de02eda': '1', 'num_task_resize_finish': '1', 'num_proj_ef6342a70d63478b87507cf6ab897736': '1', 'num_proj_9e3020791dcd4ef4b7980dd196a8ca96': '3', 'num_proj_94910fada777407994d5908d5c1de121': '2', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_442924f56f0d49859aaa6ff4af8d78c0': '1', 'num_task_block_device_mapping': '1'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:48:30.967950 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.977354 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.977608 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.987149 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:30.987504 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:31.030977 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] Jun 09 11:48:31.030977 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] successful. Jun 09 11:48:31.030977 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:31.041447 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] Jun 09 11:48:31.041447 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] successful. Jun 09 11:48:31.041447 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:31.046405 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:31.058209 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.065973 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:31.066548 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:31.072073 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] HCTL ('13', '-', '-', 0) found on session 19 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:31.072073 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.079228 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:31.079663 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:31.080381 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:31.082017 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] HCTL ('14', '-', '-', 0) found on session 20 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:31.082191 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:31.096906 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:31.097162 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] VM Started (Lifecycle Event) Jun 09 11:48:31.100544 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 19 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:31.100544 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:31.100544 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 20 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:31.100889 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:31.216583 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:31.217422 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'keypairs' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:31.411547 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:31.566291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:31.566291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:31.601797 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:31.603626 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:31.603626 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] VM Paused (Lifecycle Event) Jun 09 11:48:31.620020 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:31.640874 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:31.670620 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000941596999837202 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:31.671307 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:31.671307 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] VM Stopped (Lifecycle Event) Jun 09 11:48:31.672383 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:31.672540 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.303776586999902 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:31.672613 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.3036810670000705 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:31.722657 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:31.726119 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:31.764414 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:31.764414 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:31.771444 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Updating instance_info_cache with network_info: [{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:31.878368 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Creating config drive at /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config.rescue Jun 09 11:48:31.882376 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwex5vj_b {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:31.899459 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:31.922379 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwex5vj_b" returned: 0 in 0.040s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:32.067651 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:48:32.107535 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:32.108994 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:32.173927 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 3c6c08b5-e35f-48de-8928-810d426a8122] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:32.265081 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:32.273883 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:32.274467 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance network_info: |[{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:48:32.337926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:32.338235 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:32.350105 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.377396 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.381542 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.470960 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.612304 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:32.624896 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:32.631286 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2fcdbe0d-d5b8-4ba6-9749-eac17a73b84b req-6d1ea723-770b-4463-8b7c-5cd47c0d9841 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:32.631818 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2fcdbe0d-d5b8-4ba6-9749-eac17a73b84b req-6d1ea723-770b-4463-8b7c-5cd47c0d9841 service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:32.632239 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2fcdbe0d-d5b8-4ba6-9749-eac17a73b84b req-6d1ea723-770b-4463-8b7c-5cd47c0d9841 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:32.632239 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2fcdbe0d-d5b8-4ba6-9749-eac17a73b84b req-6d1ea723-770b-4463-8b7c-5cd47c0d9841 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:32.632239 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2fcdbe0d-d5b8-4ba6-9749-eac17a73b84b req-6d1ea723-770b-4463-8b7c-5cd47c0d9841 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:32.632527 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-2fcdbe0d-d5b8-4ba6-9749-eac17a73b84b req-6d1ea723-770b-4463-8b7c-5cd47c0d9841 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state active and task_state rescuing. Jun 09 11:48:32.719498 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.724015 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.726408 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.777346 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:48:32.777346 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.897s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:32.777346 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.153s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:32.780799 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:48:32.780799 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Claim successful on node np0000002435 Jun 09 11:48:32.783130 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.02 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:48:32.841779 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:48:32.859114 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.878138 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:32.915620 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Found WWN 330000000e692b5bd for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:32.916058 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:32.916058 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000e692b5bd', 'path': '/dev/dm-5', 'multipath_id': '330000000e692b5bd'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:32.916154 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e692b5bd', 'path': '/dev/dm-5', 'multipath_id': '330000000e692b5bd'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:32.916608 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.244s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:32.917137 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '62987121-0060-46e6-ae2e-5127db252bc6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:48:32.917137 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:32.958947 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:32.959312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:48:32.959715 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '16')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:32.960380 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6', '15')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:32.961801 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Resulting device map defaultdict(. at 0x77d909ab4ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'): ({'sdf'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:48:32.962740 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Removing multipathed devices sdg, sdf {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:48:32.962740 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Flush multipath device 3300000003794021f {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:48:32.988586 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:33.037702 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:33.083370 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:48:33.083370 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:48:33.087485 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:48:33.101372 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:48:33.102008 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:48:33.116067 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:33.147757 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.40.100,3260] Jun 09 11:48:33.147757 np0000002435 nova-compute[98325]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.40.100,3260] successful. Jun 09 11:48:33.147757 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:33.180807 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:33.193008 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:33.223763 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:33.234352 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.50.100,3260] Jun 09 11:48:33.234352 np0000002435 nova-compute[98325]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-62987121-0060-46e6-ae2e-5127db252bc6, portal: 192.168.50.100,3260] successful. Jun 09 11:48:33.234352 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:33.242624 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:33.261292 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:33.261292 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:33.261292 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] <== disconnect_volume: return (2586ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:33.261292 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:48:33.265773 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:33.296756 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for f973e06e-5d44-4393-abce-509f80f2db62 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:48:33.296974 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:33.297135 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Resumed (Lifecycle Event) Jun 09 11:48:33.302901 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-63b7e59d-632c-4fb1-99a1-67e1a229943e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:33.304949 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:33.305254 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:33.315216 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:33.319817 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe89:eb33', 'fe80::3c5e:86ff:fe67:90f1', 'fe80::fc16:3eff:fe2d:5bbd', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25', 'fe80::fc16:3eff:fec2:a2bd', 'fe80::2865:18ff:fe97:9818', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::484b:d3ff:fea1:37b7'] Jun 09 11:48:33.319984 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:33.320090 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:33.320315 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:33.320477 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Updating existing volume attachment record: 6740b84a-faf8-4d4c-95b8-d21856dcd3b7 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:33.402679 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:33.421110 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:17Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:33.421392 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:33.422001 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] End _get_guest_xml xml= Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: instance-00000004 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 262144 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-server-1443682971 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 2026-06-09 11:48:29 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 256 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: True Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: bare Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: ide Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: pc Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-436431080-project-member Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-436431080 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: 075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: Jun 09 11:48:33.423530 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:33.426236 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:17Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:33.426236 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57824003-network", "vif_mac": "fa:16:3e:33:f9:9d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:33.426422 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:33.426422 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:33.426422 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:33.426422 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:33.426422 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:33.426422 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:33.426592 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd07d40ff-ad4b-5819-a915-ea20a990d6b9', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:33.429006 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:33.430852 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:33.430961 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc607e9-d1, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:33.431242 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfc607e9-d1, col_values=(('qos', UUID('fbcb3de2-b99c-446b-ab4e-0ddfbbcc0081')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:33.431410 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfc607e9-d1, col_values=(('external_ids', {'iface-id': 'dfc607e9-d1c6-474b-b876-d24787b0e300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f9:9d', 'vm-uuid': 'c5797bda-6c93-417f-be59-a3c76be89e7e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:33.432004 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:33.433030 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:33.442823 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:33.443859 np0000002435 nova-compute[98325]: INFO os_vif [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') Jun 09 11:48:33.805779 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:33.810332 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:33.826569 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'flavor' on Instance uuid 20e2f567-45b9-4beb-b58c-6e62b337525d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:34.316476 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:34.316476 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Started (Lifecycle Event) Jun 09 11:48:34.529608 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Unrescuing Jun 09 11:48:34.530018 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:34.530155 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:34.530397 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:34.616552 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:34.616781 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:34.708556 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2f645c59-22c0-480c-8aa9-8c021b87634e req-753480de-020f-4529-8d27-0d2d5e9d3e98 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:34.708889 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2f645c59-22c0-480c-8aa9-8c021b87634e req-753480de-020f-4529-8d27-0d2d5e9d3e98 service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:34.710325 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2f645c59-22c0-480c-8aa9-8c021b87634e req-753480de-020f-4529-8d27-0d2d5e9d3e98 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:34.711504 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2f645c59-22c0-480c-8aa9-8c021b87634e req-753480de-020f-4529-8d27-0d2d5e9d3e98 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:34.711504 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2f645c59-22c0-480c-8aa9-8c021b87634e req-753480de-020f-4529-8d27-0d2d5e9d3e98 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:34.711504 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-2f645c59-22c0-480c-8aa9-8c021b87634e req-753480de-020f-4529-8d27-0d2d5e9d3e98 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state rescued and task_state unrescuing. Jun 09 11:48:34.804372 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c2adfbb-4550-4577-aec3-92c34466e594 req-39ff97f8-88a1-4457-aa75-7d072885de1b service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-plugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:34.804372 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c2adfbb-4550-4577-aec3-92c34466e594 req-39ff97f8-88a1-4457-aa75-7d072885de1b service nova] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:34.804372 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c2adfbb-4550-4577-aec3-92c34466e594 req-39ff97f8-88a1-4457-aa75-7d072885de1b service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:34.804372 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c2adfbb-4550-4577-aec3-92c34466e594 req-39ff97f8-88a1-4457-aa75-7d072885de1b service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:34.804372 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c2adfbb-4550-4577-aec3-92c34466e594 req-39ff97f8-88a1-4457-aa75-7d072885de1b service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Processing event network-vif-plugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:48:34.804372 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:48:34.806783 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:48:34.809327 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Instance spawned successfully. Jun 09 11:48:34.809377 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:48:34.819333 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:34.821562 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:34.835186 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e993ecb0-edaa-495c-8ccb-6912b02b4969 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.840s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:34.970617 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:34.970766 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:34.970815 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:34.970910 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] No VIF found with MAC fa:16:3e:33:f9:9d, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:34.971730 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Using config drive Jun 09 11:48:35.035497 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:35.120731 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:35.318910 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:35.319064 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:35.319405 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:35.319658 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:35.319916 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:35.320141 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:35.325721 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.333356 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 09 11:48:35.333356 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:35.333356 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] VM Resumed (Lifecycle Event) Jun 09 11:48:35.459462 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:48:35.459462 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:48:35.459462 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Creating image(s) Jun 09 11:48:35.459904 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:48:35.460290 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Ensure instance console log exists: /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:35.462073 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:35.462939 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.462939 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:35.463804 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Start _get_guest_xml network_info=[{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'bac006c2-baff-4c37-8d24-8d4799d6583b', 'attached_at': '', 'detached_at': '', 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'serial': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'}, 'attachment_id': '6740b84a-faf8-4d4c-95b8-d21856dcd3b7', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:35.466055 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:35.467819 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-599615834', uuid='bac006c2-baff-4c37-8d24-8d4799d6583b'), owner=OwnerMeta(userid='ddbd75a95df64400a7a3db15ee91196e', username='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member', projectid='4b166f86497e4dbfb0ea7e1850584656', projectname='tempest-ServerBootFromVolumeStableRescueTest-252292105'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005715.4673126) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:35.470404 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:35.470805 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:35.474441 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:35.474441 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:35.474441 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:35.474441 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:35.474441 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:35.474441 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:35.476042 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:35.476436 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:35.476847 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:35.477224 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:35.477558 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:35.477903 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:35.479301 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:35.479301 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:35.494987 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:35.495603 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:35.495973 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:35.496532 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:35.496932 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:35.513365 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:35.514068 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:35.514683 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:35.514933 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:35.515749 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:35.515749 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:35.524326 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:35.531116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:35.531116 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:35.535221 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:35.535221 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1] added Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:35.543623 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1] added Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:35.547479 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:35.547793 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:35.547975 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:35.548203 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:35.568284 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.594830 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.599848 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.635290 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.855s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:35.635290 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.231s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.635290 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:48:35.640064 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:48:35.640304 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Claim successful on node np0000002435 Jun 09 11:48:35.701694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:35.701694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.701694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:35.701694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.702185 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:35.705362 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Terminating instance Jun 09 11:48:35.721231 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.771593 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:35.824910 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-44876374-9230-437d-b77c-906c6b27e6ee req-2d7f7156-0cc8-448b-8c73-7be51d32f200 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:35.825369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-44876374-9230-437d-b77c-906c6b27e6ee req-2d7f7156-0cc8-448b-8c73-7be51d32f200 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:35.826016 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-44876374-9230-437d-b77c-906c6b27e6ee req-2d7f7156-0cc8-448b-8c73-7be51d32f200 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.829715 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-44876374-9230-437d-b77c-906c6b27e6ee req-2d7f7156-0cc8-448b-8c73-7be51d32f200 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:35.830491 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-44876374-9230-437d-b77c-906c6b27e6ee req-2d7f7156-0cc8-448b-8c73-7be51d32f200 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:35.830651 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-44876374-9230-437d-b77c-906c6b27e6ee req-2d7f7156-0cc8-448b-8c73-7be51d32f200 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state active and task_state resize_finish. Jun 09 11:48:35.833447 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Took 10.82 seconds to spawn the instance on the hypervisor. Jun 09 11:48:35.833838 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:35.838289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:35.839293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.839293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:35.839293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:35.839293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:35.840702 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:35.844717 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Terminating instance Jun 09 11:48:35.849722 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:35.942829 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.945320 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:35.977096 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003311680000024353 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:35.977096 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:35.977096 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.5787498979998418 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:35.977096 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.5786320769998383 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:35.977502 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.145425 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:48:36.147342 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:48:36.147664 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:36.147910 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:36.211156 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:48:36.218858 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d422c8cd17d4fe5b548032f10c7c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3020791dcd4ef4b7980dd196a8ca96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:48:36.237287 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.240793 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.263038 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.274378 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:36.274938 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'flavor' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:36.352313 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:48:36.353037 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Took 16.88 seconds to build instance. Jun 09 11:48:36.355516 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:36.380580 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.385396 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.409017 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.436905 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.451314 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.482250 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.517104 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.518957 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.544182 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:36.549608 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:36.558452 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001098417000093832 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:36.558452 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:36.559571 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:36.559571 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Stopped (Lifecycle Event) Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:36.563500 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:36.580449 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.583649 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.588720 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999731766999957 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:36.588995 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance event wait completed in 0 seconds for {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:48:36.589441 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for c5797bda-6c93-417f-be59-a3c76be89e7e due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:48:36.589578 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:36.589745 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Resumed (Lifecycle Event) Jun 09 11:48:36.599811 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.988774136000075 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:36.603879 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.986081899000055 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:36.606333 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.614728 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Instance destroyed successfully. Jun 09 11:48:36.615119 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'resources' on Instance uuid 909cacb1-a84f-45bf-b343-ab2e830208c7 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:36.616168 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance running successfully. Jun 09 11:48:36.622395 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Failed to set time: agent not configured {{(pid=98325) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 09 11:48:36.622395 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1d81fcac-6f5e-4a0b-9500-fc0679910eb1 tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] finish_migration finished successfully. {{(pid=98325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12908}} Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.626527 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.627950 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.644531 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.644810 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:36.654985 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:48:36.690629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.40.100,3260] Jun 09 11:48:36.690629 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.40.100,3260] successful. Jun 09 11:48:36.690629 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.706996 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.50.100,3260] Jun 09 11:48:36.706996 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.50.100,3260] successful. Jun 09 11:48:36.706996 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.707740 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.728242 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.737639 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.738012 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:36.738764 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:36.738963 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:36.746877 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('11', '-', '-', 0) found on session 21 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:36.747064 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:36.761643 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:36.762417 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.247s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:36.762417 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:36.764355 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('12', '-', '-', 0) found on session 22 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:36.764355 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Instance destroyed successfully. Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lazy-loading 'resources' on Instance uuid 20e2f567-45b9-4beb-b58c-6e62b337525d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 21 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] No waiting events found dispatching network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] Acquiring lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:36.851116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:36.856970 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] No waiting events found dispatching network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:36.856970 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4b1a61b9-40c8-409e-a5cd-732238eb6cf6 req-d7bb79ed-4124-4368-9965-36cbf875cd04 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-unplugged-e8a74c52-55ef-4f12-811a-9909791cf2be for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:36.856970 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 22 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:36.856970 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:36.856970 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.860842 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9ce0a93a-a07b-4a65-9d03-30d430ee3ac4 tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.401s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:36.882672 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.889532 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.947239 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:36.960728 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Successfully created port: e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:48:37.066081 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:37.107792 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:37.120839 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:37.123562 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1955933568-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testmultiattachvolumeswap-server-1955933568-1',id=8,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dHRkrhueaMQcxoJlDVMI97zTM0STm8k3OWEtoeKN3KbBwc9/o+wr2GIbG5MVCsdammXnulk/XaaRIyJTtvifHA6CyZoJz3M9D4y7MvyQ/zbJETqL46zOh7ZAIKi6SiA==',key_name='tempest-keypair-1618552104',keypairs=,launch_index=0,launched_at=2026-06-09T11:47:16Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='94910fada777407994d5908d5c1de121',ramdisk_id='',reservation_id='r-o06cnakl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-911853440',owner_user_name='tempest-TestMultiAttachVolumeSwap-911853440-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e744c937528439ca06004bbeaae0f21',uuid=909cacb1-a84f-45bf-b343-ab2e830208c7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:37.124805 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converting VIF {"id": "e8a74c52-55ef-4f12-811a-9909791cf2be", "address": "fa:16:3e:89:eb:33", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a74c52-55", "ovs_interfaceid": "e8a74c52-55ef-4f12-811a-9909791cf2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:37.124805 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:37.124805 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:37.132307 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.132307 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a74c52-55, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:37.136657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:37.152362 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.155129 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.155129 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7786ad91-e89e-458b-b766-29463d7dd685) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:37.156716 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:37.160310 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:48:37.186995 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.195916 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-plugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:37.198996 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:37.201465 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:37.201465 np0000002435 nova-compute[98325]: INFO os_vif [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=e8a74c52-55ef-4f12-811a-9909791cf2be,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a74c52-55') Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] No waiting events found dispatching network-vif-plugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received unexpected event network-vif-plugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d for instance with vm_state active and task_state None. Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing instance network info cache due to event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:37.204245 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:37.213148 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Deleting instance files /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7_del Jun 09 11:48:37.240633 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance destroyed successfully. Jun 09 11:48:37.243326 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'numa_topology' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:37.252980 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Deletion of /opt/stack/data/nova/instances/909cacb1-a84f-45bf-b343-ab2e830208c7_del complete Jun 09 11:48:37.282709 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1955933568-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testmultiattachvolumeswap-server-1955933568-2',id=9,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+dHRkrhueaMQcxoJlDVMI97zTM0STm8k3OWEtoeKN3KbBwc9/o+wr2GIbG5MVCsdammXnulk/XaaRIyJTtvifHA6CyZoJz3M9D4y7MvyQ/zbJETqL46zOh7ZAIKi6SiA==',key_name='tempest-keypair-1618552104',keypairs=,launch_index=1,launched_at=2026-06-09T11:47:19Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='94910fada777407994d5908d5c1de121',ramdisk_id='',reservation_id='r-o06cnakl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-911853440',owner_user_name='tempest-TestMultiAttachVolumeSwap-911853440-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e744c937528439ca06004bbeaae0f21',uuid=20e2f567-45b9-4beb-b58c-6e62b337525d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:37.282709 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converting VIF {"id": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "address": "fa:16:3e:2d:5b:bd", "network": {"id": "e1874613-6355-4f85-a107-d16245d3b8d5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1796042232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "94910fada777407994d5908d5c1de121", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49bd34b5-99", "ovs_interfaceid": "49bd34b5-99d7-4615-9653-01ff6a59c4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:37.283044 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:37.283523 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:37.288798 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.288995 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49bd34b5-99, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:37.292144 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:37.297599 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.300304 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.300447 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e2d7cfe-3e80-4845-944a-88190a452d9f) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:37.302937 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:37.307468 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:37.312061 np0000002435 nova-compute[98325]: INFO os_vif [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5b:bd,bridge_name='br-int',has_traffic_filtering=True,id=49bd34b5-99d7-4615-9653-01ff6a59c4cf,network=Network(e1874613-6355-4f85-a107-d16245d3b8d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49bd34b5-99') Jun 09 11:48:37.312579 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Deleting instance files /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d_del Jun 09 11:48:37.315654 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Deletion of /opt/stack/data/nova/instances/20e2f567-45b9-4beb-b58c-6e62b337525d_del complete Jun 09 11:48:37.517842 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:37.629992 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 09 11:48:37.629992 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:37.629992 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Started (Lifecycle Event) Jun 09 11:48:37.716025 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:37.759525 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:37.767521 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Took 1.56 seconds to destroy the instance on the hypervisor. Jun 09 11:48:37.767992 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:48:37.768452 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:48:37.768543 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:48:37.768759 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:37.820678 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Took 1.47 seconds to destroy the instance on the hypervisor. Jun 09 11:48:37.821159 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:48:37.821560 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:48:37.821720 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:48:37.821997 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:37.867889 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:37.868373 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:37.904051 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:37.917882 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:37.918086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:37.918883 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:37.918883 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:37.918883 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:37.918883 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state resized and task_state None. Jun 09 11:48:37.918883 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:37.918883 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:37.919345 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:37.919345 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:37.919345 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] No waiting events found dispatching network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:37.921422 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:37.921879 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:37.922292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Acquiring lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:37.923839 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:37.924021 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:37.924202 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] No waiting events found dispatching network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:37.925326 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d918ea6b-a1d0-44bd-a9f9-4edd86a04789 req-eb041fc8-ddf7-463d-88e3-f45d4d17426b service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-unplugged-49bd34b5-99d7-4615-9653-01ff6a59c4cf for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:37.939161 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:38.035515 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Successfully updated port: e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:48:38.135255 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:38.141781 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:38.176901 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:48:38.180892 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:48:38.181224 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Creating image(s) Jun 09 11:48:38.181823 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:38.182545 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:38.183649 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:38.183952 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:38.190971 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:38.192972 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:38.281449 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.313136 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.316328 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.123s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:38.317475 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.317948 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:38.318473 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:38.321449 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:38.325925 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:38.325925 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:38.372662 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:38.402515 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.431139 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.106s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:38.431614 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:38.504121 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk 1073741824" returned: 0 in 0.072s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:38.504764 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.186s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:38.505282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:38.540562 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:38.540562 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:38.540562 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:38.556683 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Found WWN 330000000ab81a238 for multipath device dm-4 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:38.557234 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.061s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:38.559287 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== connect_volume: return (3061ms) {'type': 'block', 'scsi_wwn': '330000000ab81a238', 'path': '/dev/dm-4', 'multipath_id': '330000000ab81a238'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:38.559287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ab81a238', 'path': '/dev/dm-4', 'multipath_id': '330000000ab81a238'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:38.615577 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:38.615577 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:48:38.615577 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:38.647848 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.998148098000001 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:38.648204 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999818318999814 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:38.708942 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:38.711929 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:38.712628 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Cannot resize image /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:48:38.713059 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:38.713218 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Ensure instance console log exists: /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:38.713676 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:38.713865 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:38.714198 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:38.726422 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.761934 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.763839 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:38.859389 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updated VIF entry in instance network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:38.859761 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:38.861629 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:38.891139 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.258s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:38.891783 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:48:38.929553 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:38.929642 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:38.929815 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:38.929932 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:38.932055 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:38.932717 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state rescued and task_state unrescuing. Jun 09 11:48:38.933205 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:38.933432 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:38.933627 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:38.933723 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:38.933881 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:38.934069 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state rescued and task_state unrescuing. Jun 09 11:48:38.934105 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:38.934301 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing instance network info cache due to event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:38.934418 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:38.975291 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:39.070862 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-599615834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-599615834',id=16,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-cojqgtzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:29Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=bac006c2-baff-4c37-8d24-8d4799d6583b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:39.071066 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:39.071679 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:39.072332 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'pci_devices' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:39.138944 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:39.329456 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for f973e06e-5d44-4393-abce-509f80f2db62 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:48:39.329616 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:39.329741 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Resumed (Lifecycle Event) Jun 09 11:48:39.331894 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-d7f090f8-1ae4-49f1-97a1-26312525f246 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:39.343598 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.362917 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:39.363110 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:39.363316 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing instance network info cache due to event network-changed-0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:39.363498 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Acquiring lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:39.363652 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Acquired lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:39.366809 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Refreshing network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:39.368624 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Took 1.55 seconds to deallocate network for instance. Jun 09 11:48:39.400509 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:48:39.400509 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:48:39.400669 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.401318 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.479711 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Took 1.71 seconds to deallocate network for instance. Jun 09 11:48:39.483714 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350f4bb6b83542a8bc518e4b17c544c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70287265cfb743eea99ae30fed46f234', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:48:39.523617 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] End _get_guest_xml xml= Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: instance-00000010 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-server-599615834 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 2026-06-09 11:48:35 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: True Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: bare Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: 93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: Jun 09 11:48:39.575913 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:39.577910 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Preparing to wait for external event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:39.577910 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:39.577910 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:39.577910 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:39.577910 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-599615834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-599615834',id=16,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-cojqgtzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:29Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=bac006c2-baff-4c37-8d24-8d4799d6583b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:39.578144 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:39.578805 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:39.579098 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:39.579436 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.579696 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:39.579958 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:39.580955 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.581143 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a4f088-b588-5708-bcd6-550090db0b50', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:39.581982 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.582813 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:39.583409 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.587318 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.587553 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap128e9294-09, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:39.587952 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap128e9294-09, col_values=(('qos', UUID('de8ef9c2-37fb-4bd6-a582-394c68495c5d')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:39.588185 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap128e9294-09, col_values=(('external_ids', {'iface-id': '128e9294-0996-449b-a826-33c4bb2d14e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:6a:2b', 'vm-uuid': 'bac006c2-baff-4c37-8d24-8d4799d6583b'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:39.589723 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.591891 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:39.597360 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:39.598656 np0000002435 nova-compute[98325]: INFO os_vif [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') Jun 09 11:48:39.633558 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.673777 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:48:39.775942 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.776235 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.776621 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.832921 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:39.837250 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:39.873217 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:39.884610 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:39.884799 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:39.904306 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:48:39.918448 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Port dfc607e9-d1c6-474b-b876-d24787b0e300 binding to destination host np0000002435 is already ACTIVE {{(pid=98325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 09 11:48:39.918657 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:39.918774 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:39.918876 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:39.993438 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:40.025137 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-83e5e19f-7de6-42a7-bb6f-867edf8c056c req-ae5f37f6-ce3b-4ed9-b384-cca1a4c14d24 service nova] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Received event network-vif-deleted-e8a74c52-55ef-4f12-811a-9909791cf2be {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:40.027035 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:40.027369 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance network_info: |[{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:48:40.028426 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:40.028648 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:40.037515 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Start _get_guest_xml network_info=[{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:40.040202 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:40.041167 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b6f3bff5-5831-44df-8fb2-55bb82329aab'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005720.04082) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:40.052032 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:40.054949 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:40.057710 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:40.061122 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:40.061882 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:40.062364 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:40.062593 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:40.062850 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:40.064562 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:40.064602 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:40.064871 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:40.065069 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:40.065204 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:40.065387 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:40.065532 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:40.065695 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:40.085984 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Successfully created port: 002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:48:40.096943 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=17,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-je49h29z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=b6f3bff5-5831-44df-8fb2-55bb82329aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:40.097154 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:40.100028 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:40.102401 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'pci_devices' on Instance uuid b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:40.227842 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.324297 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.346016 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:40.346258 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Started (Lifecycle Event) Jun 09 11:48:40.408877 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:48:40.430057 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:40.487110 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:40.539913 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] End _get_guest_xml xml= Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: b6f3bff5-5831-44df-8fb2-55bb82329aab Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: instance-00000011 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: multiattach-server-0 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 2026-06-09 11:48:40 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: True Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: bare Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: b6f3bff5-5831-44df-8fb2-55bb82329aab Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: b6f3bff5-5831-44df-8fb2-55bb82329aab Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: Jun 09 11:48:40.605854 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:40.608563 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Preparing to wait for external event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:40.608563 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:40.608563 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:40.608563 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:40.610365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=17,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-je49h29z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=b6f3bff5-5831-44df-8fb2-55bb82329aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:40.611186 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:40.612158 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:40.612839 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:40.613465 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.613673 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:40.613845 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:40.617131 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.617439 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ee072c-1f4e-55ed-b745-945f361e7f3f', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:40.618698 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.620473 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.620866 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:40.634379 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.642046 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.642046 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7556c29-41, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:40.642438 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7556c29-41, col_values=(('qos', UUID('b3b61e2b-8f5b-4454-bb5c-44ef84a3130d')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:40.642698 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7556c29-41, col_values=(('external_ids', {'iface-id': 'e7556c29-4189-4614-a64c-3b34768b7ad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:9f:81', 'vm-uuid': 'b6f3bff5-5831-44df-8fb2-55bb82329aab'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:40.648683 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:40.659185 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:40.662098 np0000002435 nova-compute[98325]: INFO os_vif [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') Jun 09 11:48:40.852720 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:40.856769 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:40.956006 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Successfully updated port: 002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:48:41.015615 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:41.015803 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:41.036499 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-36cd251a-f305-4e5d-b891-5dc1404a8889 req-91f90ffa-5727-4971-ad21-21bddd25028f service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:41.036735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-36cd251a-f305-4e5d-b891-5dc1404a8889 req-91f90ffa-5727-4971-ad21-21bddd25028f service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:41.037545 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-36cd251a-f305-4e5d-b891-5dc1404a8889 req-91f90ffa-5727-4971-ad21-21bddd25028f service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:41.037947 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-36cd251a-f305-4e5d-b891-5dc1404a8889 req-91f90ffa-5727-4971-ad21-21bddd25028f service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:41.038124 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-36cd251a-f305-4e5d-b891-5dc1404a8889 req-91f90ffa-5727-4971-ad21-21bddd25028f service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:41.038501 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-36cd251a-f305-4e5d-b891-5dc1404a8889 req-91f90ffa-5727-4971-ad21-21bddd25028f service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state active and task_state None. Jun 09 11:48:41.044754 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updated VIF entry in instance network info cache for port 0e7cee76-43d3-41de-96b9-771f91b176fc. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:41.044754 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [{"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:41.121591 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:41.121786 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:41.122407 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No VIF found with MAC fa:16:3e:0c:6a:2b, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:41.124415 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Using config drive Jun 09 11:48:41.344332 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:41.357335 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:41.422925 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:48:41.428232 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:48:41.428232 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Creating image(s) Jun 09 11:48:41.428632 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "/opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:41.428972 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "/opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:41.429590 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "/opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:41.430358 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:41.433659 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:41.437950 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:41.464413 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "refresh_cache-22f70c12-29d8-4938-b488-8759bc7f706d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:41.465040 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquired lock "refresh_cache-22f70c12-29d8-4938-b488-8759bc7f706d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:41.465598 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:41.523527 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:41.538216 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.103s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:41.539140 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:41.539140 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:41.539743 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:41.547572 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:41.548133 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:41.554475 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2668698b-38c2-4954-b05b-06ff59cc61ab req-abb11be3-3567-4e65-90f1-651ea4429368 service nova] Releasing lock "refresh_cache-f973e06e-5d44-4393-abce-509f80f2db62" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:41.559344 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:41.634620 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:41.649192 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updated VIF entry in instance network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:41.649404 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:41.650727 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.102s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:41.651629 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:41.713220 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk 1073741824" returned: 0 in 0.061s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:41.716326 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.175s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:41.716326 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:41.808702 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.094s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:41.810103 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:48:41.810420 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:41.917956 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Creating config drive at /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config Jun 09 11:48:41.918502 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:41.919127 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Cannot resize image /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:48:41.919725 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:41.919964 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Ensure instance console log exists: /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:41.920279 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:41.920519 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:41.920659 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:41.925730 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2mntoth {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:41.981454 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2mntoth" returned: 0 in 0.055s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:42.045130 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.157s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:42.045130 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.049s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:42.064290 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:42.080960 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:42.111807 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-changed-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:42.111807 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Refreshing instance network info cache due to event network-changed-002fbc64-9ef8-4a93-960c-990b8060b2c4. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:42.112130 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] Acquiring lock "refresh_cache-22f70c12-29d8-4938-b488-8759bc7f706d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:42.156521 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Deleted allocations for instance 20e2f567-45b9-4beb-b58c-6e62b337525d Jun 09 11:48:42.177570 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:42.177801 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Received event network-vif-deleted-49bd34b5-99d7-4615-9653-01ff6a59c4cf {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:42.177977 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:42.178218 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:42.178464 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:42.178624 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:42.178777 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:42.178932 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-7f1a2325-0916-4416-ba1e-380a2882bd6e req-1844deca-6663-4a66-b4fa-e9286a967b9c service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-plugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state rescued and task_state unrescuing. Jun 09 11:48:42.196853 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:42.197567 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:42.197567 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:7d:9f:81, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:42.197567 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Using config drive Jun 09 11:48:42.363220 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:42.457537 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.469937 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.496869 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.500892 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.592108 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Creating tmpfile /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/tmplnxfvyj3 to verify with other compute node that the instance is on the same shared storage. {{(pid=98325) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10578}} Jun 09 11:48:42.592108 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:48:42.611645 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.646657 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Updating instance_info_cache with network_info: [{"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:42.703637 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:42.725073 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.736984 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:42.869680 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Creating config drive at /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config Jun 09 11:48:42.875421 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp88c04ksx {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:42.920008 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp88c04ksx" returned: 0 in 0.044s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:43.126366 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.129070 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.150080 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Releasing lock "refresh_cache-22f70c12-29d8-4938-b488-8759bc7f706d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:43.151114 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:43.151724 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Instance network_info: |[{"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:48:43.152474 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] Acquired lock "refresh_cache-22f70c12-29d8-4938-b488-8759bc7f706d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:43.152562 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:43.155339 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Refreshing network info cache for port 002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:43.159698 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.162417 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Start _get_guest_xml network_info=[{"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:43.174876 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8a61992-7fea-47fd-ba72-e5165ca801fc tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "20e2f567-45b9-4beb-b58c-6e62b337525d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.336s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:43.181414 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:43.182570 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1533048775', uuid='22f70c12-29d8-4938-b488-8759bc7f706d'), owner=OwnerMeta(userid='350f4bb6b83542a8bc518e4b17c544c9', username='tempest-DeleteServersTestJSON-296745865-project-member', projectid='70287265cfb743eea99ae30fed46f234', projectname='tempest-DeleteServersTestJSON-296745865'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005723.1821904) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:43.192544 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.196364 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:43.197772 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:43.205231 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:43.205440 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:43.206658 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:43.209636 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:43.210175 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:43.210354 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:43.210539 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:43.210675 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:43.210843 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:43.211041 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:43.211196 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:43.211394 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:43.211543 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:43.211709 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:43.229142 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1533048775',display_name='tempest-DeleteServersTestJSON-server-1533048775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-deleteserverstestjson-server-1533048775',id=18,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70287265cfb743eea99ae30fed46f234',ramdisk_id='',reservation_id='r-pcasl9n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-296745865',owner_user_name='tempest-DeleteServersTestJSON-296745865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:40Z,user_data=None,user_id='350f4bb6b83542a8bc518e4b17c544c9',uuid=22f70c12-29d8-4938-b488-8759bc7f706d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:43.229366 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Converting VIF {"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:43.230097 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:43.231021 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lazy-loading 'pci_devices' on Instance uuid 22f70c12-29d8-4938-b488-8759bc7f706d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:43.294305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:43.294305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:43.294305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:43.294305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:43.294305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:43.295926 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Terminating instance Jun 09 11:48:43.433096 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.468732 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.496643 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:43.496643 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Started (Lifecycle Event) Jun 09 11:48:43.630118 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.636650 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.654597 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.660590 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:43.666754 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:43.676740 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-cdac438b-777c-4ba8-b34e-1a0a63a2f2fc req-4da07c4f-a6f8-4974-8366-e780221139e2 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:43.681572 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-cdac438b-777c-4ba8-b34e-1a0a63a2f2fc req-4da07c4f-a6f8-4974-8366-e780221139e2 service nova] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:43.683251 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance destroyed successfully. Jun 09 11:48:43.683251 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-cdac438b-777c-4ba8-b34e-1a0a63a2f2fc req-4da07c4f-a6f8-4974-8366-e780221139e2 service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:43.683251 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-cdac438b-777c-4ba8-b34e-1a0a63a2f2fc req-4da07c4f-a6f8-4974-8366-e780221139e2 service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:43.683251 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-cdac438b-777c-4ba8-b34e-1a0a63a2f2fc req-4da07c4f-a6f8-4974-8366-e780221139e2 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Processing event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:48:43.684366 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'resources' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] End _get_guest_xml xml= Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 22f70c12-29d8-4938-b488-8759bc7f706d Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: instance-00000012 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: tempest-DeleteServersTestJSON-server-1533048775 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 2026-06-09 11:48:43 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: True Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: bare Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: tempest-DeleteServersTestJSON-296745865-project-member Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: tempest-DeleteServersTestJSON-296745865 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 22f70c12-29d8-4938-b488-8759bc7f706d Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 22f70c12-29d8-4938-b488-8759bc7f706d Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: Jun 09 11:48:43.736666 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:43.739465 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Preparing to wait for external event network-vif-plugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:43.739465 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:43.739465 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:43.739465 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:43.739465 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1533048775',display_name='tempest-DeleteServersTestJSON-server-1533048775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-deleteserverstestjson-server-1533048775',id=18,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70287265cfb743eea99ae30fed46f234',ramdisk_id='',reservation_id='r-pcasl9n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-296745865',owner_user_name='tempest-DeleteServersTestJSON-296745865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:40Z,user_data=None,user_id='350f4bb6b83542a8bc518e4b17c544c9',uuid=22f70c12-29d8-4938-b488-8759bc7f706d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:43.739638 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Converting VIF {"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:43.741146 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:43.742793 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:43.742793 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.742793 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:43.743452 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:43.747940 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.747940 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35c658cc-608d-509e-8ce6-34cceffe94dc', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:43.749503 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.751607 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:43.760614 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.763127 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.763127 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap002fbc64-9e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:43.763127 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap002fbc64-9e, col_values=(('qos', UUID('470265ae-80df-48a5-a372-d0746e5a2cce')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:43.763127 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap002fbc64-9e, col_values=(('external_ids', {'iface-id': '002fbc64-9ef8-4a93-960c-990b8060b2c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:ca:9e', 'vm-uuid': '22f70c12-29d8-4938-b488-8759bc7f706d'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:43.764663 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.765820 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:43.777750 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.779211 np0000002435 nova-compute[98325]: INFO os_vif [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') Jun 09 11:48:43.800294 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:48:43.836299 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.839321 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.860040 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.864578 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.883865 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:43.901681 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.001603 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:44.013174 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:44.013174 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Paused (Lifecycle Event) Jun 09 11:48:44.092105 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:44.163189 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8eb74a43-2bd7-4ead-b0b9-e58461537bd9 req-5840d773-baad-4cf4-8edc-62b80047cdbb service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-unplugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:44.163715 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-8eb74a43-2bd7-4ead-b0b9-e58461537bd9 req-5840d773-baad-4cf4-8edc-62b80047cdbb service nova] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:44.163858 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-8eb74a43-2bd7-4ead-b0b9-e58461537bd9 req-5840d773-baad-4cf4-8edc-62b80047cdbb service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:44.163858 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-8eb74a43-2bd7-4ead-b0b9-e58461537bd9 req-5840d773-baad-4cf4-8edc-62b80047cdbb service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:44.163988 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8eb74a43-2bd7-4ead-b0b9-e58461537bd9 req-5840d773-baad-4cf4-8edc-62b80047cdbb service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] No waiting events found dispatching network-vif-unplugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:44.166032 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8eb74a43-2bd7-4ead-b0b9-e58461537bd9 req-5840d773-baad-4cf4-8edc-62b80047cdbb service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-unplugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:44.176094 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.133s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:44.181172 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Instance destroyed successfully. Jun 09 11:48:44.182395 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lazy-loading 'resources' on Instance uuid 687bfd28-5f09-4036-b557-dd324ab1cc6e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:44.188414 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:37Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:44.188597 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:44.189061 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:44.189272 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:44.191303 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.191303 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc607e9-d1, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:44.192164 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:44.205704 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.209952 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.209952 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbcb3de2-b99c-446b-ab4e-0ddfbbcc0081) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:44.210493 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.211133 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:44.221578 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.224128 np0000002435 nova-compute[98325]: INFO os_vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') Jun 09 11:48:44.225895 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:48:44.226288 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:44.226438 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:44.227386 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:44.228301 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:48:44.228420 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:48:44.241252 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Deleted allocations for instance 909cacb1-a84f-45bf-b343-ab2e830208c7 Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:44.265629 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:44.265975 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:44.266167 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:48:44.266414 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '19')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:44.267487 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '20')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:48:44.268314 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Resulting device map defaultdict(. at 0x77d909aa6f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'): ({'sdi'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:48:44.268575 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Removing multipathed devices sdi, sdh {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:48:44.268800 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flush multipath device 330000000e692b5bd {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:48:44.308860 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:44.330236 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Updated VIF entry in instance network info cache for port 002fbc64-9ef8-4a93-960c-990b8060b2c4. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:44.330236 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Updating instance_info_cache with network_info: [{"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:44.352036 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:48:44.393082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:48:44.393418 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:48:44.395459 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:48:44.407066 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:48:44.407373 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:48:44.417980 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:44.461630 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] Jun 09 11:48:44.461630 np0000002435 nova-compute[98325]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] successful. Jun 09 11:48:44.461630 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:44.484086 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:44.509691 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:44.516561 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:44.518816 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:44.542172 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] Jun 09 11:48:44.542172 np0000002435 nova-compute[98325]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] successful. Jun 09 11:48:44.542172 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:44.559165 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:44.559562 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:44.559691 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== disconnect_volume: return (333ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:44.559847 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:48:44.588891 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:48:44.598550 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:48:44.600138 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance spawned successfully. Jun 09 11:48:44.600494 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:48:44.688953 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-454680300',display_name='tempest-VolumesActionsTest-instance-454680300',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesactionstest-instance-454680300',id=15,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:48:35Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='442924f56f0d49859aaa6ff4af8d78c0',ramdisk_id='',reservation_id='r-5ylm0qzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-339598293',owner_user_name='tempest-VolumesActionsTest-339598293-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:36Z,user_data=None,user_id='82b0c4212f2a4e4e8c057324dbd2ff17',uuid=687bfd28-5f09-4036-b557-dd324ab1cc6e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:48:44.688953 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Converting VIF {"id": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "address": "fa:16:3e:c2:a2:bd", "network": {"id": "f0ccbfc9-e783-4fac-912e-ac4e00711b9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1101455405-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "442924f56f0d49859aaa6ff4af8d78c0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf38b8-0e", "ovs_interfaceid": "fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:44.688953 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:44.689252 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:48:44.690577 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.690577 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbaf38b8-0e, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:44.691433 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:44.696281 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.697877 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.697877 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18d97ede-ef00-4fb1-8216-ef77e39707d1) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:44.698590 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.698590 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:44.703913 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:44.706047 np0000002435 nova-compute[98325]: INFO os_vif [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a2:bd,bridge_name='br-int',has_traffic_filtering=True,id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d,network=Network(f0ccbfc9-e783-4fac-912e-ac4e00711b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf38b8-0e') Jun 09 11:48:44.706704 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Deleting instance files /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e_del Jun 09 11:48:44.707390 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Deletion of /opt/stack/data/nova/instances/687bfd28-5f09-4036-b557-dd324ab1cc6e_del complete Jun 09 11:48:44.832066 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bd69aa99-9a0b-485a-b7d5-3bd0bc4ea311 req-1c7aaa8c-9666-4eb4-a0d5-704c9256d4f1 service nova] Releasing lock "refresh_cache-22f70c12-29d8-4938-b488-8759bc7f706d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:45.021055 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:45.021522 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999707200999865 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:45.021838 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999833186999922 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:45.022071 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:45.022214 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] VM Started (Lifecycle Event) Jun 09 11:48:45.106333 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:45.106481 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:45.106803 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:45.107044 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:45.107372 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:45.107641 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:45.214847 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Took 1.41 seconds to destroy the instance on the hypervisor. Jun 09 11:48:45.215537 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:48:45.215863 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:48:45.216028 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:48:45.216331 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:45.249566 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ef0bd23d-309a-495d-9ab2-d6b4240f52a5 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Lock "909cacb1-a84f-45bf-b343-ab2e830208c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.548s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:45.310487 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:45.310487 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:48:45.310487 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No VIF found with MAC fa:16:3e:1e:ca:9e, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:48:45.310487 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Using config drive Jun 09 11:48:45.312037 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:45.327148 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:45.525921 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:45.527661 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:45.612813 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Took 7.43 seconds to spawn the instance on the hypervisor. Jun 09 11:48:45.613004 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:45.726914 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:45.726914 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:45.762768 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:45.762880 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:45.763034 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:45.763034 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:45.763700 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] No waiting events found dispatching network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:45.763700 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received unexpected event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 for instance with vm_state active and task_state None. Jun 09 11:48:45.763700 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-deleted-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:45.763700 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Neutron deleted interface fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d; detaching it from the instance and deleting it from the info cache Jun 09 11:48:45.766680 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0524bd2c-e017-4d50-80ae-0469b407a8b9 req-f6fa9225-7800-4c72-88a5-ab6cd5e1c962 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Detach interface failed, port_id=fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d, reason: Instance 687bfd28-5f09-4036-b557-dd324ab1cc6e could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:48:45.818813 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:45.959506 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Creating config drive at /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk.config Jun 09 11:48:45.963078 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5lhxcxtr {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:46.019004 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5lhxcxtr" returned: 0 in 0.056s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:46.031355 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:46.031355 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:46.031454 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] VM Paused (Lifecycle Event) Jun 09 11:48:46.101291 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:46.129182 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Took 13.56 seconds to build instance. Jun 09 11:48:46.230300 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'migration_context' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:46.268224 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1cfc9750-bed1-432d-8ed8-c017e1651284 req-037fa672-6485-463d-a1f9-d3970169fe05 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-unplugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:46.268550 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1cfc9750-bed1-432d-8ed8-c017e1651284 req-037fa672-6485-463d-a1f9-d3970169fe05 service nova] Acquiring lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:46.268828 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1cfc9750-bed1-432d-8ed8-c017e1651284 req-037fa672-6485-463d-a1f9-d3970169fe05 service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:46.269048 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1cfc9750-bed1-432d-8ed8-c017e1651284 req-037fa672-6485-463d-a1f9-d3970169fe05 service nova] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:46.269252 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1cfc9750-bed1-432d-8ed8-c017e1651284 req-037fa672-6485-463d-a1f9-d3970169fe05 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] No waiting events found dispatching network-vif-unplugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:46.271960 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1cfc9750-bed1-432d-8ed8-c017e1651284 req-037fa672-6485-463d-a1f9-d3970169fe05 service nova] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Received event network-vif-unplugged-fbaf38b8-0eb3-4f5e-a7ec-ee5793c1713d for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:48:46.534703 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:46.542419 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:46.543806 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] VM Resumed (Lifecycle Event) Jun 09 11:48:46.551754 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:46.582932 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:46.604616 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Took 1.39 seconds to deallocate network for instance. Jun 09 11:48:46.631123 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.068s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:46.705905 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:46.734924 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Object Instance lazy-loaded attributes: resources,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:46.978013 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:46.981550 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:46.983838 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:47.023920 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:47.047300 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:47.048972 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:47.114638 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:47.575377 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:47.575732 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] VM Started (Lifecycle Event) Jun 09 11:48:47.631923 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:47.634475 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:47.845219 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Received event network-changed-618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:47.846329 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Refreshing instance network info cache due to event network-changed-618aa879-88cc-4085-a5cc-76b96ca1b199. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:47.846329 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] Acquiring lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:47.846329 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] Acquired lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:47.846488 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Refreshing network info cache for port 618aa879-88cc-4085-a5cc-76b96ca1b199 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:48.077947 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:48.080144 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:48.080292 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] VM Paused (Lifecycle Event) Jun 09 11:48:48.136049 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:48.349439 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:48.583085 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:48.587560 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:48.742946 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:48.865380 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-946bca97-7cd1-4b6a-a488-59a35eb45660 req-c61ff028-926a-4235-99e4-f78ae04b72ad service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:48.865380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-946bca97-7cd1-4b6a-a488-59a35eb45660 req-c61ff028-926a-4235-99e4-f78ae04b72ad service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:48.865380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-946bca97-7cd1-4b6a-a488-59a35eb45660 req-c61ff028-926a-4235-99e4-f78ae04b72ad service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:48.865380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-946bca97-7cd1-4b6a-a488-59a35eb45660 req-c61ff028-926a-4235-99e4-f78ae04b72ad service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:48.865380 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-946bca97-7cd1-4b6a-a488-59a35eb45660 req-c61ff028-926a-4235-99e4-f78ae04b72ad service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Processing event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:48:48.867933 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:48:48.869598 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:48:48.873046 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance spawned successfully. Jun 09 11:48:48.875157 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:48:48.888287 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updated VIF entry in instance network info cache for port 618aa879-88cc-4085-a5cc-76b96ca1b199. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:48.888287 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: 91b55628-1195-485f-910b-bf2d27fd4bd8] Updating instance_info_cache with network_info: [{"id": "618aa879-88cc-4085-a5cc-76b96ca1b199", "address": "fa:16:3e:0e:03:55", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap618aa879-88", "ovs_interfaceid": "618aa879-88cc-4085-a5cc-76b96ca1b199", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:49.090111 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:49.090533 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:49.091172 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Resumed (Lifecycle Event) Jun 09 11:48:49.117152 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:49.117815 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:49.156077 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.429s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:49.156471 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.041s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:49.156703 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:48:49.245549 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6aed231c-6b50-4a4f-ab5d-4c028c73763e req-360aff70-8ac5-4d16-98d3-48b85dbd7d26 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-plugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:49.245549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6aed231c-6b50-4a4f-ab5d-4c028c73763e req-360aff70-8ac5-4d16-98d3-48b85dbd7d26 service nova] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:49.245549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6aed231c-6b50-4a4f-ab5d-4c028c73763e req-360aff70-8ac5-4d16-98d3-48b85dbd7d26 service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:49.245549 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6aed231c-6b50-4a4f-ab5d-4c028c73763e req-360aff70-8ac5-4d16-98d3-48b85dbd7d26 service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:49.245549 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6aed231c-6b50-4a4f-ab5d-4c028c73763e req-360aff70-8ac5-4d16-98d3-48b85dbd7d26 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Processing event network-vif-plugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:48:49.246853 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:48:49.252584 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:48:49.261501 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Instance spawned successfully. Jun 09 11:48:49.263434 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:48:49.383295 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.385365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.385365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.385365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.385365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.385365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.393176 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] Releasing lock "refresh_cache-91b55628-1195-485f-910b-bf2d27fd4bd8" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:49.393342 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:49.393523 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing instance network info cache due to event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:49.393694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:49.393814 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:49.393929 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:49.595967 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:49.599636 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:49.622525 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:48:49.699585 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:49.776133 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.776133 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.776133 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.776133 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.776133 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.776562 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:48:49.892358 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Took 14.43 seconds to spawn the instance on the hypervisor. Jun 09 11:48:49.892358 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:49.900391 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:50.102795 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:48:50.102795 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:50.102795 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] VM Resumed (Lifecycle Event) Jun 09 11:48:50.206052 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:50.206052 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:50.226302 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:50.284057 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Took 8.86 seconds to spawn the instance on the hypervisor. Jun 09 11:48:50.284216 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:50.329315 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:50.402666 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Took 28.54 seconds to build instance. Jun 09 11:48:50.566155 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:50.606057 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:50.610336 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:48:50.708982 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:50.769273 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Swapping old allocation on dict_keys(['d3492327-ddbb-4ac4-8f97-93fcb625bcd0']) held by migration 2d8719ec-f4bd-4e20-b985-f4d7b8544ccb for instance Jun 09 11:48:50.794905 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Took 17.45 seconds to build instance. Jun 09 11:48:50.797829 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:50.900009 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Overwriting current allocation {'allocations': {'d3492327-ddbb-4ac4-8f97-93fcb625bcd0': {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}, 'generation': 23}}, 'project_id': 'ef6342a70d63478b87507cf6ab897736', 'user_id': 'ddafbf9dd6d14df9aa70526de4ceade9', 'consumer_generation': 1} on consumer c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jun 09 11:48:50.908101 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.060s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:50.986778 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:51.007422 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:51.020784 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updated VIF entry in instance network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:48:51.021164 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:51.037767 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:51.038243 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:51.038688 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:51.038817 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:51.039621 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:51.039759 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state active and task_state None. Jun 09 11:48:51.039897 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:51.040095 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:51.040409 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:51.040409 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:51.040409 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state resized and task_state resize_reverting. Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:51.041109 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9d9bb1f9-3d17-45c8-9b7c-d86c7e7d6e8a req-38924787-7898-4bff-ad70-36a79c885e1c service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state resized and task_state resize_reverting. Jun 09 11:48:51.099654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:51.099750 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquired lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:51.099856 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:51.222043 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.066s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:51.223440 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.998s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:51.227717 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:48:51.227864 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Claim successful on node np0000002435 Jun 09 11:48:51.291408 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Deleted allocations for instance 687bfd28-5f09-4036-b557-dd324ab1cc6e Jun 09 11:48:51.301918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.964s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:51.340532 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2b5fe7d4-2aae-4a66-a56b-a32d97115e14 req-f88bbeb8-44ab-48d7-b830-a737a9ae1029 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-plugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:51.342462 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2b5fe7d4-2aae-4a66-a56b-a32d97115e14 req-f88bbeb8-44ab-48d7-b830-a737a9ae1029 service nova] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:51.342757 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2b5fe7d4-2aae-4a66-a56b-a32d97115e14 req-f88bbeb8-44ab-48d7-b830-a737a9ae1029 service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:51.342991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2b5fe7d4-2aae-4a66-a56b-a32d97115e14 req-f88bbeb8-44ab-48d7-b830-a737a9ae1029 service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:51.343313 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2b5fe7d4-2aae-4a66-a56b-a32d97115e14 req-f88bbeb8-44ab-48d7-b830-a737a9ae1029 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] No waiting events found dispatching network-vif-plugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:51.343467 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-2b5fe7d4-2aae-4a66-a56b-a32d97115e14 req-f88bbeb8-44ab-48d7-b830-a737a9ae1029 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received unexpected event network-vif-plugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 for instance with vm_state active and task_state None. Jun 09 11:48:51.524501 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9f0a1a51-9658-4912-840b-45ca6be58af6 req-1c97ed5a-a33a-4871-909f-fee5f838f8d0 service nova] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:51.589008 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003822969999873749 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:51.590029 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:51.590029 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] VM Stopped (Lifecycle Event) Jun 09 11:48:51.591501 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:51.591650 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.0541548040000635 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:51.591752 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.0540371839999807 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:51.602023 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:52.082231 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:52.094337 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-99a636b8-60a7-4371-8100-7fe130dbe449 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 909cacb1-a84f-45bf-b343-ab2e830208c7] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:52.303117 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-31fc31d0-f477-4afb-ba63-534c3fb5134f tempest-VolumesActionsTest-339598293 tempest-VolumesActionsTest-339598293-project-member] Lock "687bfd28-5f09-4036-b557-dd324ab1cc6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.010s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:52.305400 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:52.473976 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Rescuing Jun 09 11:48:52.474191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:52.474335 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:52.474479 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:52.807332 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Releasing lock "refresh_cache-c5797bda-6c93-417f-be59-a3c76be89e7e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:52.807688 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:52.825538 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:52.851709 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:52.885681 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:52.886079 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:52.897007 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:52.901319 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe0c:6a2b', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:fe1e:ca9e', 'fe80::18ac:21ff:fe1b:939'] Jun 09 11:48:52.901319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:52.901319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:52.901319 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:52.978550 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:53.041218 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:48:53.041218 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:48:53.327447 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:53.327447 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:53.364310 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:53.544979 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:48:53.620867 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Updating instance_info_cache with network_info: [{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:53.646785 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007188209999640094 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.649289 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:53.649417 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.649705 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] VM Stopped (Lifecycle Event) Jun 09 11:48:53.651292 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-0.00227347700001701 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.651533 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.003459952000184785 future=) was cancelled while queued, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.651659 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.651808 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.369386329000008 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.651925 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=6.369285779999927 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:53.685771 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:53.831975 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lazy-loading 'flavor' on Instance uuid 22f70c12-29d8-4938-b488-8759bc7f706d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:54.053509 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.830s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:54.053864 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:48:54.056381 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Starting finish_revert_migration {{(pid=98325) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12958}} Jun 09 11:48:54.076685 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start _get_guest_xml network_info=[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c5797bda-6c93-417f-be59-a3c76be89e7e', 'attached_at': '2026-06-09T11:48:53.000000', 'detached_at': '', 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'serial': '075c1506-9b16-45be-880d-540d6f2974c9'}, 'attachment_id': '90c9424e-555c-4a41-8556-dc876cbb95ff', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:54.084098 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:54.085012 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1443682971', uuid='c5797bda-6c93-417f-be59-a3c76be89e7e'), owner=OwnerMeta(userid='ddafbf9dd6d14df9aa70526de4ceade9', username='tempest-ServerActionsTestOtherB-436431080-project-member', projectid='ef6342a70d63478b87507cf6ab897736', projectname='tempest-ServerActionsTestOtherB-436431080'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005734.0846372) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:54.090824 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:54.091109 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:54.092158 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:54.092797 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:54.093384 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:54.093724 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:54.093899 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:54.094081 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:54.094210 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:54.094636 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:54.094636 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:54.094719 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:54.094829 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:54.094991 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:54.095128 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:54.095455 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:54.095593 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:54.124541 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:54.155714 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 20e2f567-45b9-4beb-b58c-6e62b337525d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:48:54.559566 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:48:54.560077 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:48:54.560131 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:54.560402 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:54.615148 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:54.653754 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:54.681289 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d422c8cd17d4fe5b548032f10c7c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3020791dcd4ef4b7980dd196a8ca96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:48:54.701203 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:54.704857 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.config --force-share --output=json" returned: 0 in 0.090s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:54.705242 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:54.705554 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:54.707247 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "/opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:54.707247 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:54.707247 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:54.707247 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:54.707247 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:54.707574 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:54.733129 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:54.734618 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:54.734618 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:54.735063 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:54.735912 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:54.736166 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:54.757493 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:54.757493 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:54.763143 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:54.763143 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9] added Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:54.776373 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9] added Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:54.780449 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:54.780728 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:54.781004 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0448(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:54.781168 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:54.840704 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:55.069294 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:48:55.332274 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:55.371293 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Successfully created port: 1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:48:55.572784 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:48:55.770182 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:55.773106 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:55.776640 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:55.784503 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:55.798577 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.801093 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:55.806496 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.819335 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.825182 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.835698 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.835988 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.849472 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:55.887654 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] Jun 09 11:48:55.887654 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] successful. Jun 09 11:48:55.887654 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.902167 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] Jun 09 11:48:55.902167 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] successful. Jun 09 11:48:55.902167 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.909712 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.916515 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.941219 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] HCTL ('13', '-', '-', 0) found on session 23 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:55.942679 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:55.943015 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] HCTL ('14', '-', '-', 0) found on session 24 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:55.943015 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:55.961932 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 23 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:55.961932 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:55.971426 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Searching for a device in session 24 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:55.971426 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:55.980359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:55.981584 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:55.984624 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Attaching volume 76a57e7b-ece2-49ca-9d1a-874d572f7cb3 to /dev/vdb Jun 09 11:48:56.009087 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:56.016559 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:56.066686 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:56.085760 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:48:56.126067 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Successfully updated port: 1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:48:56.131921 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99566668500006 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:48:56.132592 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:56.150306 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance destroyed successfully. Jun 09 11:48:56.159861 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'numa_topology' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:56.181311 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:48:56.182105 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:48:56.194230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:48:56.198577 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:fe1e:ca9e', 'fe80::18ac:21ff:fe1b:939'] Jun 09 11:48:56.198577 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:48:56.200585 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:48:56.200585 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:56.200585 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Updating existing volume attachment record: 8ff88527-afdc-4de8-990e-58a22bcec0a0 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:48:56.245378 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:56.248367 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing instance network info cache due to event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:48:56.248367 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:56.248367 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:56.248367 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:48:56.569151 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6e67d52e-2f59-44fe-8856-6d49e6485f01 req-3366e476-d987-461c-98a6-0c37c2940491 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:56.572284 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e67d52e-2f59-44fe-8856-6d49e6485f01 req-3366e476-d987-461c-98a6-0c37c2940491 service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:56.572284 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e67d52e-2f59-44fe-8856-6d49e6485f01 req-3366e476-d987-461c-98a6-0c37c2940491 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:56.572284 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e67d52e-2f59-44fe-8856-6d49e6485f01 req-3366e476-d987-461c-98a6-0c37c2940491 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:56.572284 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6e67d52e-2f59-44fe-8856-6d49e6485f01 req-3366e476-d987-461c-98a6-0c37c2940491 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:56.572284 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-6e67d52e-2f59-44fe-8856-6d49e6485f01 req-3366e476-d987-461c-98a6-0c37c2940491 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state active and task_state rescuing. Jun 09 11:48:56.589463 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:48:56.593383 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:48:56.593383 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Creating image(s) Jun 09 11:48:56.593383 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:56.594652 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:56.595310 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:56.596003 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:56.603224 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:56.604468 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:56.649730 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:48:56.675987 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Attempting a stable device rescue Jun 09 11:48:56.720453 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.116s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:56.721083 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:56.721083 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:56.721623 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:56.724513 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:56.725282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:56.744105 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:56.755172 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:56.785355 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:48:56.785769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:48:56.786703 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:56.794727 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 09 11:48:56.801140 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:48:56.801476 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Creating image(s) Jun 09 11:48:56.802358 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "/opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:56.802604 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:56.803070 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:56.803220 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'trusted_certs' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:56.820031 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.094s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:56.820031 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:56.842139 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:56.871118 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk 1073741824" returned: 0 in 0.051s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:56.871920 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.150s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:56.871920 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:56.955044 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.083s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:56.955567 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:48:56.955846 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:57.048691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:57.049408 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Cannot resize image /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:48:57.049855 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:57.050103 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Ensure instance console log exists: /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:48:57.050579 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:57.050855 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:57.051061 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:57.069338 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:57.306910 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:57.307309 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "4551b5bd985fb490f8e93713c2b7da6002f60571" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:57.307778 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "4551b5bd985fb490f8e93713c2b7da6002f60571" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:57.427238 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:57.572759 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3735472a-6880-4ca6-b8d1-869376237d02 req-ddb6d68f-18a1-4492-8657-5e1aa8b724a2 service nova] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:57.575889 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:48:57.575889 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:48:57.773609 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Found WWN 330000000e692b5bd for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:48:57.774123 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.067s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:57.774123 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== connect_volume: return (3067ms) {'type': 'block', 'scsi_wwn': '330000000e692b5bd', 'path': '/dev/dm-5', 'multipath_id': '330000000e692b5bd'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:48:57.775032 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e692b5bd', 'path': '/dev/dm-5', 'multipath_id': '330000000e692b5bd'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:48:57.775882 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.989s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:57.776297 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:48:57.799098 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:57.800127 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:48:57.801124 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:57.801124 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:57.801733 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:48:57.806209 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:57.824309 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:57.824309 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:57.837011 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:48:57.837011 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3] added Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:57.849979 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:57.852615 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:57.852615 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0496(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:57.852615 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3] added Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:48:57.857403 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:57.858396 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:48:57.858396 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0565(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:48:57.858396 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:48:58.188898 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:48:58.208333 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:58.211805 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:58.212148 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:58.283678 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:37Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:58.283995 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:58.291608 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] End _get_guest_xml xml= Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: instance-00000004 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-server-1443682971 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 2026-06-09 11:48:54 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: True Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: bare Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: ide Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: pc Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-436431080-project-member Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherB-436431080 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: 075c1506-9b16-45be-880d-540d6f2974c9 Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: Jun 09 11:48:58.295056 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:58.297827 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Preparing to wait for external event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:58.297827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:58.297827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:58.297827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:58.297994 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:37Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:58.297994 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:58.298142 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:58.298142 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:58.298779 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.300466 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:58.301118 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:58.304031 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.304447 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd07d40ff-ad4b-5819-a915-ea20a990d6b9', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:58.305672 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.307704 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:58.314626 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.316498 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.part --force-share --output=json" returned: 0 in 0.104s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:58.319339 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] 2afbdc77-ce05-435f-a8c4-b09bea018c19 was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:48:58.320349 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.320985 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:48:58.321457 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc607e9-d1, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:58.321824 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfc607e9-d1, col_values=(('qos', UUID('77747d44-901c-48e5-b5b2-e77de6bd17c0')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:58.322399 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.part /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:58.322852 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfc607e9-d1, col_values=(('external_ids', {'iface-id': 'dfc607e9-d1c6-474b-b876-d24787b0e300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f9:9d', 'vm-uuid': 'c5797bda-6c93-417f-be59-a3c76be89e7e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:58.325014 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.326979 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:58.348683 np0000002435 nova-compute[98325]: INFO os_vif [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') Jun 09 11:48:58.434013 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.part /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.converted" returned: 0 in 0.112s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:58.443755 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:58.480922 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:48:58.555911 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571.converted --force-share --output=json" returned: 0 in 0.113s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:58.556638 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "4551b5bd985fb490f8e93713c2b7da6002f60571" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.249s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:58.557129 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:58.564530 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:58.566877 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "4551b5bd985fb490f8e93713c2b7da6002f60571" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:58.568030 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "4551b5bd985fb490f8e93713c2b7da6002f60571" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:58.568030 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:58.571050 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:48:58.572085 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:58.584848 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.663782 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-475ed15c-fdd1-4aea-89bd-5007b1d8dee9 req-7f99afa7-694e-4883-a6a9-8c7bbeeef638 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:48:58.664101 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-475ed15c-fdd1-4aea-89bd-5007b1d8dee9 req-7f99afa7-694e-4883-a6a9-8c7bbeeef638 service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:58.664393 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-475ed15c-fdd1-4aea-89bd-5007b1d8dee9 req-7f99afa7-694e-4883-a6a9-8c7bbeeef638 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:58.664534 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-475ed15c-fdd1-4aea-89bd-5007b1d8dee9 req-7f99afa7-694e-4883-a6a9-8c7bbeeef638 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:58.664693 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-475ed15c-fdd1-4aea-89bd-5007b1d8dee9 req-7f99afa7-694e-4883-a6a9-8c7bbeeef638 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:48:58.664833 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-475ed15c-fdd1-4aea-89bd-5007b1d8dee9 req-7f99afa7-694e-4883-a6a9-8c7bbeeef638 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state active and task_state rescuing. Jun 09 11:48:58.675054 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571 --force-share --output=json" returned: 0 in 0.103s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:58.678037 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571,backing_fmt=raw /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.rescue {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:48:58.722378 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:48:58.730655 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4551b5bd985fb490f8e93713c2b7da6002f60571,backing_fmt=raw /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.rescue" returned: 0 in 0.053s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:48:58.732179 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "4551b5bd985fb490f8e93713c2b7da6002f60571" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.164s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:58.732179 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'migration_context' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:58.852298 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:48:58.858920 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:58.871500 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:48:58.884736 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:58.903819 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.903819 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:58.908252 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.928064 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.929116 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:58.936852 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:58.942720 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:59.010431 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.50.100,3260] Jun 09 11:48:59.010431 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.50.100,3260] successful. Jun 09 11:48:59.010431 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:59.021204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.40.100,3260] Jun 09 11:48:59.021204 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.40.100,3260] successful. Jun 09 11:48:59.021204 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:59.032045 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:59.039084 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:48:59.040338 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.064668 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.064987 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:59.065195 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:59.065468 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:59.068037 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] HCTL ('15', '-', '-', 0) found on session 25 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:59.068037 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.280s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:48:59.080048 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:48:59.082812 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] HCTL ('16', '-', '-', 0) found on session 26 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:48:59.082812 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:48:59.100480 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Searching for a device in session 25 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:59.100480 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:59.118090 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Searching for a device in session 26 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:48:59.118090 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:48:59.227414 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:48:59.227764 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance network_info: |[{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:48:59.231215 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Start _get_guest_xml network_info=[{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:59.236032 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:59.236032 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:48:59.237689 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Start _get_guest_xml network_info=[{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:0c:6a:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue={'image_id': '2afbdc77-ce05-435f-a8c4-b09bea018c19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'bac006c2-baff-4c37-8d24-8d4799d6583b', 'attached_at': '', 'detached_at': '', 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'serial': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'}, 'attachment_id': '6740b84a-faf8-4d4c-95b8-d21856dcd3b7', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:48:59.237689 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'resources' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:59.241850 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:59.243119 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='a2861c32-71b0-4b66-a389-6bb079d7624e'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005739.2426631) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:59.246500 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:59.246500 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:59.247630 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:59.247692 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:59.249641 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:59.250029 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:59.250461 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:59.250620 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:59.250832 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:59.250920 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:59.251070 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:59.251332 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:59.251492 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:59.251643 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:59.252506 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:59.252689 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:59.275051 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=19,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-9xateyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=a2861c32-71b0-4b66-a389-6bb079d7624e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:48:59.276203 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:59.276697 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:59.277656 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'pci_devices' on Instance uuid a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:59.363431 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.372506 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.376366 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.411130 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.419518 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.741849 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:48:59.746201 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:48:59.746201 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-599615834', uuid='bac006c2-baff-4c37-8d24-8d4799d6583b'), owner=OwnerMeta(userid='ddbd75a95df64400a7a3db15ee91196e', username='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member', projectid='4b166f86497e4dbfb0ea7e1850584656', projectname='tempest-ServerBootFromVolumeStableRescueTest-252292105'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:0c:6a:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005739.7457862) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:48:59.749691 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:48:59.749691 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:48:59.754318 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:48:59.754770 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'vcpu_model' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] End _get_guest_xml xml= Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: a2861c32-71b0-4b66-a389-6bb079d7624e Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: instance-00000013 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 196608 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: multiattach-server-1 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 2026-06-09 11:48:59 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 192 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: True Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: bare Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 0 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: virtio Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: a2861c32-71b0-4b66-a389-6bb079d7624e Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: a2861c32-71b0-4b66-a389-6bb079d7624e Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: hvm Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 128 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: 1 Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: Jun 09 11:48:59.780533 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:48:59.782220 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Preparing to wait for external event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:48:59.782220 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:48:59.782220 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:48:59.782220 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:48:59.782426 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=19,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-9xateyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=a2861c32-71b0-4b66-a389-6bb079d7624e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:48:59.782628 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:48:59.783083 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:48:59.783374 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:48:59.783839 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.785355 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:59.785568 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:48:59.786667 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.786854 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52c43327-679e-5015-9efc-5b7a32c503f3', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:59.788638 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.789248 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:59.795573 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.797987 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.798174 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e6b875f-6e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:59.798491 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e6b875f-6e, col_values=(('qos', UUID('10f42587-8bc2-4114-86cf-6a88837abfbd')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:59.798656 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e6b875f-6e, col_values=(('external_ids', {'iface-id': '1e6b875f-6eac-4420-a223-2c0bf4553264', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:18:51', 'vm-uuid': 'a2861c32-71b0-4b66-a389-6bb079d7624e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:48:59.801081 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.804066 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:48:59.804506 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:48:59.810621 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:48:59.811805 np0000002435 nova-compute[98325]: INFO os_vif [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') Jun 09 11:48:59.958190 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for c5797bda-6c93-417f-be59-a3c76be89e7e due to new event Started> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:48:59.958615 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:48:59.958615 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Started (Lifecycle Event) Jun 09 11:49:00.021738 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004707850000613689 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.021873 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.021997 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-0.00032360900013372884 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.022154 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00048459000004186237 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.022230 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.022354 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.104879789000051 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.022453 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=11.104770945000155 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:00.023742 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:00.023942 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] VM Stopped (Lifecycle Event) Jun 09 11:49:00.260287 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:49:00.272087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:00.334349 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:00.364766 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:00.365346 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "/opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:00.365564 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:00.366086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "/opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:00.366495 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:49:00.366913 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:00.367080 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:00.462800 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:00.468291 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:00.468291 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Paused (Lifecycle Event) Jun 09 11:49:00.528063 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 687bfd28-5f09-4036-b557-dd324ab1cc6e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:00.823587 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Found WWN 330000000d53b04fb for multipath device dm-9 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:49:00.823587 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:00.823587 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '330000000d53b04fb', 'path': '/dev/dm-9', 'multipath_id': '330000000d53b04fb'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:00.823587 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d53b04fb', 'path': '/dev/dm-9', 'multipath_id': '330000000d53b04fb'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:49:00.823587 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.456s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:00.824241 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:49:00.825865 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lazy-loading 'flavor' on Instance uuid 22f70c12-29d8-4938-b488-8759bc7f706d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:00.843271 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:00.844813 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:00.846306 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:00.846563 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:49:00.847455 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:00.847455 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:00.864339 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:00.872949 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:00.879923 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:00.888655 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.901367 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.901653 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:00.901863 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:00.901863 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:00.902632 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('11', '0', '0', 0) found on session 21 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:00.902737 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.910363 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:00.910731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:00.911054 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:00.912032 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 21 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:00.912201 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:00.912845 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] HCTL ('12', '0', '0', 0) found on session 22 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:00.912980 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:00.920443 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Searching for a device in session 22 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:00.920560 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:00.964037 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:00.969161 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:00.971041 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:01.331558 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Attempting to attach volume 76a57e7b-ece2-49ca-9d1a-874d572f7cb3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] attach device xml: Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: 76a57e7b-ece2-49ca-9d1a-874d572f7cb3 Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: Jun 09 11:49:01.333863 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:49:01.337328 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:01.337328 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:01.337328 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:3d:18:51, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:01.337594 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Using config drive Jun 09 11:49:01.473448 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jun 09 11:49:01.843736 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:01.848275 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:49:02.056066 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Creating config drive at /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config Jun 09 11:49:02.063288 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpusq6uyf4 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:02.104375 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpusq6uyf4" returned: 0 in 0.043s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:02.613153 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:02.663213 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:02.755500 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:02.811245 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:02.817709 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:02.868677 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Found WWN 330000000ab81a238 for multipath device dm-4 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:49:02.869092 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:02.869325 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== connect_volume: return (2502ms) {'type': 'block', 'scsi_wwn': '330000000ab81a238', 'path': '/dev/dm-4', 'multipath_id': '330000000ab81a238'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:02.869498 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ab81a238', 'path': '/dev/dm-4', 'multipath_id': '330000000ab81a238'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:49:03.053415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:03.053415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:03.053415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:03.053415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] No VIF found with MAC fa:16:3e:1e:ca:9e, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:03.376667 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-599615834',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-599615834',id=16,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:48:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-cojqgtzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:48:50Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=bac006c2-baff-4c37-8d24-8d4799d6583b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:0c:6a:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:49:03.377293 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "vif_mac": "fa:16:3e:0c:6a:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:03.377549 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:03.378204 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'pci_devices' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:03.381986 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:03.582427 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:03.588313 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:03.588502 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] VM Started (Lifecycle Event) Jun 09 11:49:03.792651 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-32dbcb74-94d1-41c4-ad5c-cd6400792f7b req-e8e7e8bd-8fd6-4d07-9d9d-8e5ab975c929 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:03.792797 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-32dbcb74-94d1-41c4-ad5c-cd6400792f7b req-e8e7e8bd-8fd6-4d07-9d9d-8e5ab975c929 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:03.794307 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-32dbcb74-94d1-41c4-ad5c-cd6400792f7b req-e8e7e8bd-8fd6-4d07-9d9d-8e5ab975c929 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:03.794466 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-32dbcb74-94d1-41c4-ad5c-cd6400792f7b req-e8e7e8bd-8fd6-4d07-9d9d-8e5ab975c929 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:03.794844 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-32dbcb74-94d1-41c4-ad5c-cd6400792f7b req-e8e7e8bd-8fd6-4d07-9d9d-8e5ab975c929 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Processing event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:49:03.795882 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:49:03.802692 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance running successfully. Jun 09 11:49:03.802999 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] finish_revert_migration finished successfully. {{(pid=98325) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13004}} Jun 09 11:49:03.882397 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] End _get_guest_xml xml= Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: instance-00000010 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 196608 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-server-599615834 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 2026-06-09 11:48:59 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 192 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: True Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: bare Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: ide Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: pc Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: tempest-ServerBootFromVolumeStableRescueTest-252292105 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: hvm Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 128 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: 93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: Jun 09 11:49:03.884432 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:49:03.889244 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance destroyed successfully. Jun 09 11:49:04.094341 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:04.094341 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:04.094341 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] VM Paused (Lifecycle Event) Jun 09 11:49:04.595748 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:04.599505 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:04.628510 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-24992cfa-00f3-45bb-ae28-413076c2dd23 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.647s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:04.810434 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:04.876317 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-63600e97-ec09-4db1-95dd-0e2adfa749dc tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance to original state: 'active' Jun 09 11:49:04.981772 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:04.982606 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:04.985281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:04.985281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:04.985281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:04.987140 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Terminating instance Jun 09 11:49:05.106650 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:49:05.107411 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:05.107411 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Resumed (Lifecycle Event) Jun 09 11:49:05.337700 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:05.416434 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:05.416581 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:05.416724 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:05.417062 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] No VIF found with MAC fa:16:3e:0c:6a:2b, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:05.417625 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Using config drive Jun 09 11:49:05.494546 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:05.529090 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:05.532907 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:05.554815 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:05.561696 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:05.593725 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:05.611779 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:05.618425 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:05.871848 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Instance destroyed successfully. Jun 09 11:49:05.871848 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lazy-loading 'resources' on Instance uuid 22f70c12-29d8-4938-b488-8759bc7f706d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:05.925033 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'ec2_ids' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:06.087649 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-11042c0a-af56-4c9c-83de-1b8db5d04439 req-046cdb03-06f9-45ce-8bd4-e2dc9b74111e service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-unplugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:06.088118 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-11042c0a-af56-4c9c-83de-1b8db5d04439 req-046cdb03-06f9-45ce-8bd4-e2dc9b74111e service nova] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:06.088345 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-11042c0a-af56-4c9c-83de-1b8db5d04439 req-046cdb03-06f9-45ce-8bd4-e2dc9b74111e service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:06.088420 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-11042c0a-af56-4c9c-83de-1b8db5d04439 req-046cdb03-06f9-45ce-8bd4-e2dc9b74111e service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:06.088530 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-11042c0a-af56-4c9c-83de-1b8db5d04439 req-046cdb03-06f9-45ce-8bd4-e2dc9b74111e service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] No waiting events found dispatching network-vif-unplugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:06.088652 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-11042c0a-af56-4c9c-83de-1b8db5d04439 req-046cdb03-06f9-45ce-8bd4-e2dc9b74111e service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-unplugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:06.113314 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:06.113893 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:06.114069 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received unexpected event network-vif-plugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with vm_state active and task_state None. Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Processing event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:06.115490 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:06.115996 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:06.115996 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:06.115996 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] No waiting events found dispatching network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:06.115996 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-52babfa1-1718-4afa-bdfd-55380ac34316 req-71d4c737-9b80-48d7-9239-1cab060ce7dc service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received unexpected event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 for instance with vm_state building and task_state spawning. Jun 09 11:49:06.116568 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:49:06.119549 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:49:06.122149 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999699306000139 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:06.122367 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:06.124467 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] VM Resumed (Lifecycle Event) Jun 09 11:49:06.124467 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance spawned successfully. Jun 09 11:49:06.124744 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:49:06.315604 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.374294 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1533048775',display_name='tempest-DeleteServersTestJSON-server-1533048775',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-deleteserverstestjson-server-1533048775',id=18,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:48:50Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='70287265cfb743eea99ae30fed46f234',ramdisk_id='',reservation_id='r-pcasl9n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-296745865',owner_user_name='tempest-DeleteServersTestJSON-296745865-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:50Z,user_data=None,user_id='350f4bb6b83542a8bc518e4b17c544c9',uuid=22f70c12-29d8-4938-b488-8759bc7f706d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:06.374494 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Converting VIF {"id": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "address": "fa:16:3e:1e:ca:9e", "network": {"id": "aef5d4f7-bf03-4a50-b847-bdac588bc81c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1111436737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "70287265cfb743eea99ae30fed46f234", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap002fbc64-9e", "ovs_interfaceid": "002fbc64-9ef8-4a93-960c-990b8060b2c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:06.375384 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:06.375487 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:06.387639 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.387980 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap002fbc64-9e, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:06.390915 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.392389 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:06.398565 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.401072 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.401170 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=470265ae-80df-48a5-a372-d0746e5a2cce) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:06.402852 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.403559 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:06.411351 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:06.412844 np0000002435 nova-compute[98325]: INFO os_vif [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=002fbc64-9ef8-4a93-960c-990b8060b2c4,network=Network(aef5d4f7-bf03-4a50-b847-bdac588bc81c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap002fbc64-9e') Jun 09 11:49:06.416511 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:49:06.417560 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:06.417560 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:06.417560 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:06.418048 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:49:06.418048 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:49:06.432152 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:49:06.432564 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'keypairs' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:06.457675 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:06.458735 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:06.459864 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:49:06.460027 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', '26')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:06.461219 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3', '25')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:06.464811 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Resulting device map defaultdict(. at 0x77d9081a8f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'): ({'sdj'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:49:06.465150 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Removing multipathed devices sdj, sdk {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:49:06.465468 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Flush multipath device 330000000d53b04fb {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:49:06.504322 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:06.562730 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:06.611448 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:49:06.611967 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:49:06.615638 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:49:06.626108 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:06.630713 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:06.641359 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:49:06.641359 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:49:06.645589 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:06.645589 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:06.645589 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:06.647591 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:06.647591 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:06.647591 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:06.661239 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:06.713930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.40.100,3260] Jun 09 11:49:06.713930 np0000002435 nova-compute[98325]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.40.100,3260] successful. Jun 09 11:49:06.713930 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:06.746960 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:06.760312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:06.802218 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.50.100,3260] Jun 09 11:49:06.802218 np0000002435 nova-compute[98325]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-76a57e7b-ece2-49ca-9d1a-874d572f7cb3, portal: 192.168.50.100,3260] successful. Jun 09 11:49:06.802218 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:06.834249 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:06.838904 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:06.839546 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] <== disconnect_volume: return (422ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:06.839654 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:49:06.839928 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Deleting instance files /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d_del Jun 09 11:49:06.840531 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Deletion of /opt/stack/data/nova/instances/22f70c12-29d8-4938-b488-8759bc7f706d_del complete Jun 09 11:49:06.937392 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:49:06.942578 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:07.120286 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Creating config drive at /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config.rescue Jun 09 11:49:07.125778 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_dmrcbl0 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:07.142170 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:49:07.160726 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Took 10.57 seconds to spawn the instance on the hypervisor. Jun 09 11:49:07.160951 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:07.180863 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_dmrcbl0" returned: 0 in 0.055s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:07.353815 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Took 1.86 seconds to destroy the instance on the hypervisor. Jun 09 11:49:07.355091 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:07.355322 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:07.355507 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:07.355982 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:07.680691 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Took 17.54 seconds to build instance. Jun 09 11:49:07.734977 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:07.771916 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:07.819617 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:07.819617 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:07.819617 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:07.819617 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:07.820014 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:07.822800 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Terminating instance Jun 09 11:49:07.863120 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:07.937660 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.105149 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:08.188736 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.071s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:08.248724 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.333609 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:08.354338 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.357132 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.379010 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.382779 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.416001 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:08.692032 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999641788999952 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:08.696124 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Instance destroyed successfully. Jun 09 11:49:08.697444 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lazy-loading 'resources' on Instance uuid c5797bda-6c93-417f-be59-a3c76be89e7e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:08.827068 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for bac006c2-baff-4c37-8d24-8d4799d6583b due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:49:08.827219 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:08.827323 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Resumed (Lifecycle Event) Jun 09 11:49:08.829716 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-8419e355-5d90-4f5e-bc72-005f43f53f4e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:09.031658 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f1888954-b53a-4196-9d1f-affb9af7b0a0 req-2548c440-e2b4-4053-8bcd-f831ba798b24 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:09.031861 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f1888954-b53a-4196-9d1f-affb9af7b0a0 req-2548c440-e2b4-4053-8bcd-f831ba798b24 service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:09.032073 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f1888954-b53a-4196-9d1f-affb9af7b0a0 req-2548c440-e2b4-4053-8bcd-f831ba798b24 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:09.032321 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f1888954-b53a-4196-9d1f-affb9af7b0a0 req-2548c440-e2b4-4053-8bcd-f831ba798b24 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:09.032395 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f1888954-b53a-4196-9d1f-affb9af7b0a0 req-2548c440-e2b4-4053-8bcd-f831ba798b24 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:09.032629 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-f1888954-b53a-4196-9d1f-affb9af7b0a0 req-2548c440-e2b4-4053-8bcd-f831ba798b24 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state rescued and task_state None. Jun 09 11:49:09.052354 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9a0e46d5-e354-447f-95e7-a12304530d5c req-eb58207b-f4a9-4b50-b48f-b2adee4b3124 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-unplugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:09.052354 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9a0e46d5-e354-447f-95e7-a12304530d5c req-eb58207b-f4a9-4b50-b48f-b2adee4b3124 service nova] Acquiring lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:09.052354 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9a0e46d5-e354-447f-95e7-a12304530d5c req-eb58207b-f4a9-4b50-b48f-b2adee4b3124 service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:09.052354 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9a0e46d5-e354-447f-95e7-a12304530d5c req-eb58207b-f4a9-4b50-b48f-b2adee4b3124 service nova] Lock "22f70c12-29d8-4938-b488-8759bc7f706d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:09.052354 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9a0e46d5-e354-447f-95e7-a12304530d5c req-eb58207b-f4a9-4b50-b48f-b2adee4b3124 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] No waiting events found dispatching network-vif-unplugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:09.052354 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9a0e46d5-e354-447f-95e7-a12304530d5c req-eb58207b-f4a9-4b50-b48f-b2adee4b3124 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-unplugged-002fbc64-9ef8-4a93-960c-990b8060b2c4 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:09.080707 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:09.181491 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:09.202796 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1443682971',display_name='tempest-ServerActionsTestOtherB-server-1443682971',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestotherb-server-1443682971',id=4,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD+ScRnl4lpVo2ZtDb6+QvbdKxXNDK4Uvcc2BKck0wNjv8TJensKp9SFdp4m2lcktQQUzw0SL9VeFjcTxsAJ+W5+t+B8sNrQAwuJnj0cUI6VFU2/D5JsV+vsdHYxlTHbw==',key_name='tempest-keypair-67275037',keypairs=,launch_index=0,launched_at=2026-06-09T11:49:04Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ef6342a70d63478b87507cf6ab897736',ramdisk_id='',reservation_id='r-b55xlg1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-436431080',owner_user_name='tempest-ServerActionsTestOtherB-436431080-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddafbf9dd6d14df9aa70526de4ceade9',uuid=c5797bda-6c93-417f-be59-a3c76be89e7e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:09.203087 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converting VIF {"id": "dfc607e9-d1c6-474b-b876-d24787b0e300", "address": "fa:16:3e:33:f9:9d", "network": {"id": "64b6ac66-eafb-4423-9509-efdb0d156496", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57824003-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6342a70d63478b87507cf6ab897736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc607e9-d1", "ovs_interfaceid": "dfc607e9-d1c6-474b-b876-d24787b0e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:09.203828 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:09.204148 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:09.208814 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:09.209061 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc607e9-d1, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:09.211870 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:09.213385 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:09.214355 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:09.214564 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77747d44-901c-48e5-b5b2-e77de6bd17c0) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:09.215076 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:09.215787 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:09.219472 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:09.222291 np0000002435 nova-compute[98325]: INFO os_vif [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfc607e9-d1c6-474b-b876-d24787b0e300,network=Network(64b6ac66-eafb-4423-9509-efdb0d156496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc607e9-d1') Jun 09 11:49:09.223399 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:49:09.223783 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:09.223943 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:09.224371 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:09.224775 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '075c1506-9b16-45be-880d-540d6f2974c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:49:09.224933 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:09.255522 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:09.255979 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:49:09.256376 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '23')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:09.257545 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9', '24')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:09.261982 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Resulting device map defaultdict(. at 0x77d8e0512840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'): ({'sdi'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:49:09.262280 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Removing multipathed devices sdi, sdh {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:49:09.262569 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Flush multipath device 330000000e692b5bd {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:49:09.299226 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:09.330688 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:09.334892 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:09.346035 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:09.387124 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:49:09.387339 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:49:09.388911 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:49:09.405043 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:49:09.405686 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:49:09.419282 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:09.464556 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] Jun 09 11:49:09.464556 np0000002435 nova-compute[98325]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.40.100,3260] successful. Jun 09 11:49:09.464556 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:09.489866 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:09.501012 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:09.546900 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] Jun 09 11:49:09.546900 np0000002435 nova-compute[98325]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-075c1506-9b16-45be-880d-540d6f2974c9, portal: 192.168.50.100,3260] successful. Jun 09 11:49:09.546900 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:09.572199 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:09.572199 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:09.572199 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] <== disconnect_volume: return (347ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:09.572199 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:49:09.572199 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Deleting instance files /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_del Jun 09 11:49:09.581520 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Deletion of /opt/stack/data/nova/instances/c5797bda-6c93-417f-be59-a3c76be89e7e_del complete Jun 09 11:49:09.684020 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Took 2.33 seconds to deallocate network for instance. Jun 09 11:49:09.841958 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:09.842390 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Started (Lifecycle Event) Jun 09 11:49:10.090845 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Took 1.76 seconds to destroy the instance on the hypervisor. Jun 09 11:49:10.091062 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:10.091374 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:10.091514 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:10.091836 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:10.246505 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Took 0.56 seconds to detach 1 volumes for instance. Jun 09 11:49:10.325970 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:10.342479 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:10.344540 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:10.347911 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:10.659508 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:10.752778 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:10.752778 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:10.941740 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Unrescuing Jun 09 11:49:10.941740 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:10.941740 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquired lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:10.941740 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:11.117501 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:11.118222 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:11.118393 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:11.118508 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:11.118652 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:11.118810 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state rescued and task_state unrescuing. Jun 09 11:49:11.119001 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Received event network-vif-deleted-002fbc64-9ef8-4a93-960c-990b8060b2c4 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:11.119237 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:11.119349 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:11.119484 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:11.119596 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:11.119746 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:11.119892 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:11.120029 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:11.120169 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Acquiring lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:11.120328 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:11.120494 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:11.120749 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] No waiting events found dispatching network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:11.120921 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5c2687de-7be8-4d54-9037-c1309c9c006d req-71ce17d3-8385-4f5d-b97b-2169d02f2d06 service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-unplugged-dfc607e9-d1c6-474b-b876-d24787b0e300 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:11.123639 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:11.123816 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing instance network info cache due to event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:49:11.123985 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:11.124086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:11.124205 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:49:11.127910 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006606689998989168 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:11.128030 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:11.128133 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.993689194000126 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:11.128229 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.993603824000047 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:11.443921 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:11.544833 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:11.544833 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:11.631578 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:11.687852 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:11.776459 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:12.039220 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:12.048763 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:12.179701 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:12.191213 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Took 2.10 seconds to deallocate network for instance. Jun 09 11:49:12.235959 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Updating instance_info_cache with network_info: [{"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:12.281607 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:12.281841 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:12.344447 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updated VIF entry in instance network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:49:12.344447 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:12.559535 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.806s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:12.633011 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Deleted allocations for instance 22f70c12-29d8-4938-b488-8759bc7f706d Jun 09 11:49:12.738206 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Releasing lock "refresh_cache-bac006c2-baff-4c37-8d24-8d4799d6583b" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:12.739881 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'flavor' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:12.775790 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Took 0.58 seconds to detach 1 volumes for instance. Jun 09 11:49:12.787462 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Detaching volume 94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:49:12.846705 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:12.850596 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:12.850596 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing instance network info cache due to event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:49:12.850596 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:12.850596 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:12.850596 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:49:12.867170 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Attempting to driver detach volume 94429918-165c-47c6-8334-d94b49c43bdd from mountpoint /dev/vdb Jun 09 11:49:12.878714 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Found disk vdb by alias ua-94429918-165c-47c6-8334-d94b49c43bdd {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:49:12.882462 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Found disk vdb by alias ua-94429918-165c-47c6-8334-d94b49c43bdd {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:49:12.882640 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Attempting to detach device vdb from instance f973e06e-5d44-4393-abce-509f80f2db62 from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] detach device xml: Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: 94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]:
Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: Jun 09 11:49:12.882984 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:49:12.891937 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Successfully detached device vdb from instance f973e06e-5d44-4393-abce-509f80f2db62 from the persistent domain config. Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] (1/8): Attempting to detach device vdb with device alias ua-94429918-165c-47c6-8334-d94b49c43bdd from instance f973e06e-5d44-4393-abce-509f80f2db62 from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] detach device xml: Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: 94429918-165c-47c6-8334-d94b49c43bdd Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]:
Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: Jun 09 11:49:12.892915 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:49:13.000105 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:13.002147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:13.208143 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bb863cba-c8f1-4d43-b73b-ba89deb72450 req-663842f6-6585-4e05-9a6b-5fc3026f305d service nova] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Received event network-vif-deleted-dfc607e9-d1c6-474b-b876-d24787b0e300 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:13.272924 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.275806 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.283064 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:13.283064 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:13.284004 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:13.303316 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.360542 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:13.366612 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Deleted allocations for instance c5797bda-6c93-417f-be59-a3c76be89e7e Jun 09 11:49:13.473840 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.486548 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.504666 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:13.593286 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.603792 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:13.647616 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-0238a926-8ba0-4d4b-96ee-0ace4ac1d20d tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Lock "22f70c12-29d8-4938-b488-8759bc7f706d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.665s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:13.731856 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-94429918-165c-47c6-8334-d94b49c43bdd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:49:13.737890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-94429918-165c-47c6-8334-d94b49c43bdd for instance f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:49:13.747759 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Successfully detached device vdb from instance f973e06e-5d44-4393-abce-509f80f2db62 from the live domain config. Jun 09 11:49:13.752057 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:49:13.752390 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:13.752896 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:13.752896 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:13.753129 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94429918-165c-47c6-8334-d94b49c43bdd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:49:13.753240 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:49:13.759175 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999696099999937 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:13.764341 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance destroyed successfully. Jun 09 11:49:13.766020 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'numa_topology' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:13.792186 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:13.793128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:49:13.793128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '17')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:13.793576 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd', '18')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:13.794702 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Resulting device map defaultdict(. at 0x77d909aa4f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'): ({'sdo'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:49:13.795490 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Removing multipathed devices sdo, sdn {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:49:13.799218 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Flush multipath device 33000000039069334 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:49:13.799218 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:13.799218 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Cleaning up deleted instances {{(pid=98325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} Jun 09 11:49:13.843431 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:13.906353 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:13.961622 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:13.964035 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:49:13.964208 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:49:13.966558 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:49:13.981489 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:49:13.981489 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:49:13.997752 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:14.032511 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.40.100,3260] Jun 09 11:49:14.032511 np0000002435 nova-compute[98325]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.40.100,3260] successful. Jun 09 11:49:14.032511 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:14.054034 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:14.066370 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:14.097746 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.50.100,3260] Jun 09 11:49:14.097746 np0000002435 nova-compute[98325]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-94429918-165c-47c6-8334-d94b49c43bdd, portal: 192.168.50.100,3260] successful. Jun 09 11:49:14.097746 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:14.115850 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:14.116060 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:14.116162 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] <== disconnect_volume: return (363ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:14.116423 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:49:14.179144 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updated VIF entry in instance network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:49:14.179368 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:14.215774 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:14.270771 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:49:14.302943 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] There are 0 instances to clean {{(pid=98325) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} Jun 09 11:49:14.303253 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:14.303382 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Cleaning up deleted instances with incomplete migration {{(pid=98325) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} Jun 09 11:49:14.382475 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a9157c19-e761-4470-a625-067dc5e1847b tempest-ServerActionsTestOtherB-436431080 tempest-ServerActionsTestOtherB-436431080-project-member] Lock "c5797bda-6c93-417f-be59-a3c76be89e7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.563s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:14.511386 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:14.681557 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b9e33948-af2f-4046-84d5-93eb356a466b req-cffb35f3-6ac0-42f0-afaf-52d54ed5c424 service nova] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:14.684577 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'flavor' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:14.764943 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:14.798436 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:14.807008 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:14.887920 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:14.934365 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:15.308183 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:49:15.312910 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:15.313127 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:15.313353 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:15.313523 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:15.313652 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:15.313802 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state rescued and task_state unrescuing. Jun 09 11:49:15.313946 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:15.314087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:15.315596 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:15.315711 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:15.315808 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:15.315932 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state rescued and task_state unrescuing. Jun 09 11:49:15.316021 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:15.316134 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:15.316228 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:15.316370 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:15.316719 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:15.317033 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-59e10c22-7c7f-4b9a-b368-39c8b21681b2 req-695bdee8-1531-442c-88ba-c85af350823a service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state rescued and task_state unrescuing. Jun 09 11:49:15.344157 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:15.544355 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:15.603929 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:15.604052 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:15.604302 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Attaching volume e08bd27e-dc7e-483b-9417-3238b78d1869 to /dev/vdb Jun 09 11:49:15.664285 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:15.683519 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:49:15.691240 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-99b5df45-d89a-4371-bc0e-582b06b1bc54 tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.409s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:15.711858 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:15.751244 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for bac006c2-baff-4c37-8d24-8d4799d6583b due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:49:15.751244 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:15.751244 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Resumed (Lifecycle Event) Jun 09 11:49:15.762467 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:49:15.763973 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:49:15.766527 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21c0e212-e882-4dcc-8990-970462bc4125 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:15.775944 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:49:15.777146 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25', 'fe80::fc16:3eff:fed0:5ad3', 'fe80::484b:d3ff:fea1:37b7', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe0c:6a2b'] Jun 09 11:49:15.777291 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:49:15.777399 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:49:15.777663 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:15.777890 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating existing volume attachment record: 16cb2e22-45f9-4a13-ab60-ad645c89747f {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:49:16.109090 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:16.265323 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:16.269067 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:16.357549 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:49:16.357995 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:16.359212 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:16.361303 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:16.361303 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:49:16.379225 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:16.380094 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:16.380778 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:16.382046 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:16.382414 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:49:16.383431 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:49:16.399950 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:49:16.399950 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:16.409576 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:49:16.409576 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869] added Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0404(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:49:16.424312 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869] added Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:49:16.426737 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:16.426969 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:49:16.427124 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0449(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:49:16.427280 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:49:16.771793 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:16.773628 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Started (Lifecycle Event) Jun 09 11:49:17.285874 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:17.287733 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:17.309237 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:17.309568 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:17.310307 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:17.310462 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:49:17.310921 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:17.355664 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:17.356293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:17.356293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:17.356293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:17.356495 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:17.358539 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Terminating instance Jun 09 11:49:17.423726 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:49:17.427912 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:49:17.441046 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d5fa51a6-b9bf-4421-b70f-b26e140351e7 req-e4855feb-d78a-4b1f-b6f1-0c2ba7fa4da8 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:17.444296 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d5fa51a6-b9bf-4421-b70f-b26e140351e7 req-e4855feb-d78a-4b1f-b6f1-0c2ba7fa4da8 service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:17.444296 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d5fa51a6-b9bf-4421-b70f-b26e140351e7 req-e4855feb-d78a-4b1f-b6f1-0c2ba7fa4da8 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:17.444296 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d5fa51a6-b9bf-4421-b70f-b26e140351e7 req-e4855feb-d78a-4b1f-b6f1-0c2ba7fa4da8 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:17.444296 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d5fa51a6-b9bf-4421-b70f-b26e140351e7 req-e4855feb-d78a-4b1f-b6f1-0c2ba7fa4da8 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:17.444296 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-d5fa51a6-b9bf-4421-b70f-b26e140351e7 req-e4855feb-d78a-4b1f-b6f1-0c2ba7fa4da8 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received unexpected event network-vif-plugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with vm_state active and task_state deleting. Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:17.445573 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:17.448360 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.463005 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.471664 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.481867 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.482826 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.492176 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.492503 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:17.529968 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:17.532305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:17.532305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:17.532305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:17.532305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:17.539038 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Terminating instance Jun 09 11:49:17.551752 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.50.100,3260] Jun 09 11:49:17.551752 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.50.100,3260] successful. Jun 09 11:49:17.551752 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.558303 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.40.100,3260] Jun 09 11:49:17.558303 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.40.100,3260] successful. Jun 09 11:49:17.558303 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.572158 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.576802 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.597438 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.597951 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:17.598524 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:17.598620 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:17.601360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('14', '-', '-', 0) found on session 28 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:17.601360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:17.611593 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:17.613657 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('13', '-', '-', 0) found on session 27 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:17.613825 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:17.631360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 28 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:17.631492 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:17.663294 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 27 and hctl ['13', '*', '*', 0] yield: None {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:17.719519 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:17.790510 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] During sync_power_state the instance has a pending task (deleting). Skip. Jun 09 11:49:17.819827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:17.820117 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:17.820923 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:17.821518 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:49:17.862313 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:17.895950 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:17.902621 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:17.928620 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.047316 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:18.072045 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.073233 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.077699 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.110000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.131015 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.161235 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.225874 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99959300699993 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:18.227960 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Instance destroyed successfully. Jun 09 11:49:18.228437 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'resources' on Instance uuid bac006c2-baff-4c37-8d24-8d4799d6583b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:18.399400 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999688895999952 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:18.401006 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Instance destroyed successfully. Jun 09 11:49:18.401403 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lazy-loading 'resources' on Instance uuid f973e06e-5d44-4393-abce-509f80f2db62 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:18.663153 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 27 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:18.663406 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:18.732566 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-599615834',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-599615834',id=16,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:49:08Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-cojqgtzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:49:16Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=bac006c2-baff-4c37-8d24-8d4799d6583b,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:18.732798 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "128e9294-0996-449b-a826-33c4bb2d14e2", "address": "fa:16:3e:0c:6a:2b", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap128e9294-09", "ovs_interfaceid": "128e9294-0996-449b-a826-33c4bb2d14e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:18.733587 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:18.733893 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:18.736190 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.736519 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap128e9294-09, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:18.738613 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.739145 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:18.746100 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.746426 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.746806 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de8ef9c2-37fb-4bd6-a582-394c68495c5d) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:18.748134 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.748858 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:18.754081 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.758759 np0000002435 nova-compute[98325]: INFO os_vif [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=128e9294-0996-449b-a826-33c4bb2d14e2,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128e9294-09') Jun 09 11:49:18.759843 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:49:18.760126 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:18.760252 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:18.905526 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1777809667',display_name='tempest-ServerStableDeviceRescueTest-server-1777809667',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverstabledevicerescuetest-server-1777809667',id=3,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJog5LRUAJnLmramI+tIZTLsBkK1S9u9VYhQUeQnru8fu1pzGmBeKQpQnutdjX4MSEKGyJSOMEFot91cm+xXvwnMDRWoriySF2F/yPHgLWnjp5o5PnYp+pq7xgFFTt/cw==',key_name='tempest-keypair-895276484',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:33Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='97413552cb514828acbb1e9f9de02eda',ramdisk_id='',reservation_id='r-ax4xbky3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1966995700',owner_user_name='tempest-ServerStableDeviceRescueTest-1966995700-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35bde36378d547078d9410928ae16735',uuid=f973e06e-5d44-4393-abce-509f80f2db62,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:18.905765 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converting VIF {"id": "0e7cee76-43d3-41de-96b9-771f91b176fc", "address": "fa:16:3e:d0:5a:d3", "network": {"id": "86bde52e-5e14-4e01-ae0f-3752a13129a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1370300071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97413552cb514828acbb1e9f9de02eda", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7cee76-43", "ovs_interfaceid": "0e7cee76-43d3-41de-96b9-771f91b176fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:18.906252 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:18.906538 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:18.907449 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.907718 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e7cee76-43, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:18.910134 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.910134 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:18.912791 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.913757 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.913990 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e1be85b-0d74-4503-a193-fa78abf650ff) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:18.916351 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.916351 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:18.916351 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:18.917656 np0000002435 nova-compute[98325]: INFO os_vif [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5a:d3,bridge_name='br-int',has_traffic_filtering=True,id=0e7cee76-43d3-41de-96b9-771f91b176fc,network=Network(86bde52e-5e14-4e01-ae0f-3752a13129a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7cee76-43') Jun 09 11:49:18.917945 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Deleting instance files /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62_del Jun 09 11:49:18.919250 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Deletion of /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62_del complete Jun 09 11:49:19.267665 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:49:19.269850 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000003, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/f973e06e-5d44-4393-abce-509f80f2db62/disk Jun 09 11:49:19.272656 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:19.370459 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:19.371384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:19.411957 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000b9a50607 for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:49:19.413183 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:19.413557 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:19.413745 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:49:19.414591 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.654s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:19.415808 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:49:19.416016 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:49:19.425384 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:19.432080 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Took 1.38 seconds to destroy the instance on the hypervisor. Jun 09 11:49:19.442875 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:19.442875 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:19.442875 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:19.442875 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:19.445689 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:19.458378 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:19.458724 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:19.458956 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:49:19.458956 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '21')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:19.462945 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1', '22')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:19.464063 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Resulting device map defaultdict(. at 0x77d911e2bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'): ({'sdg'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:49:19.464325 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Removing multipathed devices sdg, sdf {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:49:19.464549 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flush multipath device 330000000ab81a238 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:49:19.482819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:19.490311 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:19.528914 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:19.587609 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:19.606492 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-180df926-6624-4a36-be1c-614afca5c405 req-ca5b4bea-69c7-4734-bcde-ae4b542b3967 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:19.608020 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-180df926-6624-4a36-be1c-614afca5c405 req-ca5b4bea-69c7-4734-bcde-ae4b542b3967 service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:19.608020 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-180df926-6624-4a36-be1c-614afca5c405 req-ca5b4bea-69c7-4734-bcde-ae4b542b3967 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:19.608020 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-180df926-6624-4a36-be1c-614afca5c405 req-ca5b4bea-69c7-4734-bcde-ae4b542b3967 service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:19.608793 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-180df926-6624-4a36-be1c-614afca5c405 req-ca5b4bea-69c7-4734-bcde-ae4b542b3967 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:19.609141 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-180df926-6624-4a36-be1c-614afca5c405 req-ca5b4bea-69c7-4734-bcde-ae4b542b3967 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:19.626809 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:19.626809 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:19.659204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:49:19.664457 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:49:19.669396 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:49:19.688611 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:49:19.689004 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:49:19.712910 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:19.747558 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:19.754289 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:49:19.755327 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.40.100,3260] Jun 09 11:49:19.755327 np0000002435 nova-compute[98325]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.40.100,3260] successful. Jun 09 11:49:19.755327 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:19.759975 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:49:19.763284 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:19.781364 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:19.794397 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:19.834435 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.50.100,3260] Jun 09 11:49:19.834435 np0000002435 nova-compute[98325]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-93dd9f0c-c2fa-40a0-a0b7-b420a39328c1, portal: 192.168.50.100,3260] successful. Jun 09 11:49:19.834435 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:19.859288 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:19.859288 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:19.859288 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== disconnect_volume: return (1095ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:19.859288 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:49:19.859288 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Deleting instance files /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b_del Jun 09 11:49:19.859288 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Deletion of /opt/stack/data/nova/instances/bac006c2-baff-4c37-8d24-8d4799d6583b_del complete Jun 09 11:49:19.872529 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:19.873373 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:19.934303 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Attempting to attach volume e08bd27e-dc7e-483b-9417-3238b78d1869 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] attach device xml: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: Jun 09 11:49:19.943561 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:49:19.983956 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:19.986758 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.089761 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.090370 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.132985 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:20.190810 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.194833 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.300581 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.304299 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.346291 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:20.374622 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Took 2.51 seconds to destroy the instance on the hypervisor. Jun 09 11:49:20.377571 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:20.377984 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:20.378171 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:20.378599 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:20.403428 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.411315 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.507133 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.511431 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.601867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.603917 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:49:20.608405 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:49:20.610131 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:20.651554 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.041s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:20.652407 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=11915MB free_disk=74.21871948242188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:49:20.655503 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:20.655503 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:21.038687 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:21.122375 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000458744999832561 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:21.122615 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:21.122615 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.567981058999976 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:21.122943 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.5678843670000333 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:21.124121 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:21.124388 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] VM Stopped (Lifecycle Event) Jun 09 11:49:21.350473 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:21.628825 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-21e7bde6-eed7-4d7b-92b0-972a986f2c9e tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 22f70c12-29d8-4938-b488-8759bc7f706d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:21.639858 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:21.640057 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:21.640178 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:21.640356 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:7d:9f:81, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:21.646410 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:21.687071 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-101140cd-3e54-4902-baf4-01f7b6824bcc req-22661898-b38d-4e4c-b13c-ee76ba469e8f service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:21.687071 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-101140cd-3e54-4902-baf4-01f7b6824bcc req-22661898-b38d-4e4c-b13c-ee76ba469e8f service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:21.687071 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-101140cd-3e54-4902-baf4-01f7b6824bcc req-22661898-b38d-4e4c-b13c-ee76ba469e8f service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:21.687071 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-101140cd-3e54-4902-baf4-01f7b6824bcc req-22661898-b38d-4e4c-b13c-ee76ba469e8f service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:21.687071 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-101140cd-3e54-4902-baf4-01f7b6824bcc req-22661898-b38d-4e4c-b13c-ee76ba469e8f service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:21.687071 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-101140cd-3e54-4902-baf4-01f7b6824bcc req-22661898-b38d-4e4c-b13c-ee76ba469e8f service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:21.731412 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d8871147-3a0c-4fe4-b075-83e1fdc08fc7 req-afcf99e6-1e4a-43e5-b3c5-8e6ae32eb47d service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:21.731412 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d8871147-3a0c-4fe4-b075-83e1fdc08fc7 req-afcf99e6-1e4a-43e5-b3c5-8e6ae32eb47d service nova] Acquiring lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:21.731735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d8871147-3a0c-4fe4-b075-83e1fdc08fc7 req-afcf99e6-1e4a-43e5-b3c5-8e6ae32eb47d service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:21.731735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d8871147-3a0c-4fe4-b075-83e1fdc08fc7 req-afcf99e6-1e4a-43e5-b3c5-8e6ae32eb47d service nova] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:21.731905 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d8871147-3a0c-4fe4-b075-83e1fdc08fc7 req-afcf99e6-1e4a-43e5-b3c5-8e6ae32eb47d service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] No waiting events found dispatching network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:21.732042 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d8871147-3a0c-4fe4-b075-83e1fdc08fc7 req-afcf99e6-1e4a-43e5-b3c5-8e6ae32eb47d service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-unplugged-128e9294-0996-449b-a826-33c4bb2d14e2 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:21.745375 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 54835fc7-b0b9-4113-90ad-797bdac45590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.745503 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance f973e06e-5d44-4393-abce-509f80f2db62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.745638 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.745887 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance c2f05fbe-de86-4378-8aa5-c047f02ac7b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746034 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746303 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 91b55628-1195-485f-910b-bf2d27fd4bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746303 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 2974c892-c8d4-41cc-93aa-1c4114c3538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746414 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance bac006c2-baff-4c37-8d24-8d4799d6583b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746490 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance b6f3bff5-5831-44df-8fb2-55bb82329aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746608 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance a2861c32-71b0-4b66-a389-6bb079d7624e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:49:21.746867 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:49:21.747173 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:49:20 up 32 min, 2 users, load average: 8.40, 4.57, 2.11\n', 'num_instances': '10', 'num_vm_active': '10', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_4b166f86497e4dbfb0ea7e1850584656': '4', 'io_workload': '0', 'num_proj_9e3020791dcd4ef4b7980dd196a8ca96': '5', 'num_task_deleting': '2', 'num_proj_97413552cb514828acbb1e9f9de02eda': '1'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:49:21.876782 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-920341e6-9ffd-4e18-8f24-109427a4db3d req-7b569bbe-df90-41e4-8438-e691a1e313e1 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-deleted-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:21.876861 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-920341e6-9ffd-4e18-8f24-109427a4db3d req-7b569bbe-df90-41e4-8438-e691a1e313e1 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Neutron deleted interface 0e7cee76-43d3-41de-96b9-771f91b176fc; detaching it from the instance and deleting it from the info cache Jun 09 11:49:21.882789 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-920341e6-9ffd-4e18-8f24-109427a4db3d req-7b569bbe-df90-41e4-8438-e691a1e313e1 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Detach interface failed, port_id=0e7cee76-43d3-41de-96b9-771f91b176fc, reason: Instance f973e06e-5d44-4393-abce-509f80f2db62 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:49:22.319883 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:22.443802 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:22.444125 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:22.823191 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Took 3.38 seconds to deallocate network for instance. Jun 09 11:49:22.907994 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:22.951084 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:23.030303 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:23.030687 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:23.214891 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-64947293-3b8b-411a-bb33-19967b5e0d83 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.611s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:23.331370 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:23.413997 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Took 3.04 seconds to deallocate network for instance. Jun 09 11:49:23.464390 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:49:23.464390 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.811s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:23.464390 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:49:23.464818 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.133s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:23.535822 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:23.691139 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005792570000267006 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.691237 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.692310 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.06653252000001 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.692420 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=5.066398799999888 future=) was cancelled while queued, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.692534 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.692579 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.532841925999946 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.692652 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.532762396999942 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:23.693374 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:23.693523 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] VM Stopped (Lifecycle Event) Jun 09 11:49:23.750414 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:23.810368 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-154225c7-b3a9-465f-b23a-dc6588442e22 req-fa19a10c-527a-4ad2-98a3-c52692255193 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:23.810539 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-154225c7-b3a9-465f-b23a-dc6588442e22 req-fa19a10c-527a-4ad2-98a3-c52692255193 service nova] Acquiring lock "f973e06e-5d44-4393-abce-509f80f2db62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:23.810682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-154225c7-b3a9-465f-b23a-dc6588442e22 req-fa19a10c-527a-4ad2-98a3-c52692255193 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:23.810776 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-154225c7-b3a9-465f-b23a-dc6588442e22 req-fa19a10c-527a-4ad2-98a3-c52692255193 service nova] Lock "f973e06e-5d44-4393-abce-509f80f2db62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:23.810885 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-154225c7-b3a9-465f-b23a-dc6588442e22 req-fa19a10c-527a-4ad2-98a3-c52692255193 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] No waiting events found dispatching network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:23.811035 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-154225c7-b3a9-465f-b23a-dc6588442e22 req-fa19a10c-527a-4ad2-98a3-c52692255193 service nova] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Received unexpected event network-vif-unplugged-0e7cee76-43d3-41de-96b9-771f91b176fc for instance with vm_state deleted and task_state None. Jun 09 11:49:23.918545 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:23.950356 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:23.950670 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:23.950925 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:23.951808 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:49:23.952142 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.85 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:49:23.986182 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Took 0.57 seconds to detach 1 volumes for instance. Jun 09 11:49:23.992204 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Deleting volume: 93dd9f0c-c2fa-40a0-a0b7-b420a39328c1 {{(pid=98325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 09 11:49:23.998805 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac5b6d4b-520a-4aa7-8a37-e4dcc5a28576 req-248c0306-01f8-4660-841e-78b5654c1df3 service nova] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Received event network-vif-deleted-128e9294-0996-449b-a826-33c4bb2d14e2 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:24.178760 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:24.178935 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:24.199124 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-623f89e8-822f-4141-aeb0-d3a5a5fa4f3b tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: c5797bda-6c93-417f-be59-a3c76be89e7e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:24.552210 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.521s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:24.558799 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:24.681629 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:25.193598 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.729s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:25.196185 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.637s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:25.268671 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Deleted allocations for instance f973e06e-5d44-4393-abce-509f80f2db62 Jun 09 11:49:25.348890 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:25.664212 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:25.667003 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:25.667003 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Attaching volume e08bd27e-dc7e-483b-9417-3238b78d1869 to /dev/vdb Jun 09 11:49:25.729999 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:25.748804 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:49:25.775828 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:25.816839 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:49:25.817901 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:49:25.826578 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:49:25.827746 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe54:c962', 'fe80::fc16:3eff:fe84:8e25', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:fe3d:1851'] Jun 09 11:49:25.827919 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:49:25.828120 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:49:25.828723 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:25.828723 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating existing volume attachment record: de64a43b-8cb4-4a1b-8d1e-8cd43a470184 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:49:25.833043 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:25.833417 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:26.212901 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:26.303916 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-cf2672ee-11ea-4e72-9de1-0ccd4101ce7e tempest-ServerStableDeviceRescueTest-1966995700 tempest-ServerStableDeviceRescueTest-1966995700-project-member] Lock "f973e06e-5d44-4393-abce-509f80f2db62" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.773s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:26.337508 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:26.387526 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:26.414098 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:49:26.414485 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:26.415109 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:26.415647 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:26.415856 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:49:26.432051 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:26.433092 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:26.433646 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:26.434215 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:26.434655 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:49:26.434965 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:26.452696 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:26.457641 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:26.477660 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:26.479109 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.501319 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.501684 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:26.501851 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:26.501997 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:26.503312 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.070s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:26.503747 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:26.504165 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('13', '0', '0', 0) found on session 27 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:26.504165 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:26.504993 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('14', '0', '0', 0) found on session 28 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:26.505177 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:26.518674 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 27 and hctl ('13', '0', '0', 0) yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:26.518807 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:26.520514 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 28 and hctl ('14', '0', '0', 0) yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:26.520514 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:26.536188 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:26.698821 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:26.846305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.650s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:26.914173 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Deleted allocations for instance bac006c2-baff-4c37-8d24-8d4799d6583b Jun 09 11:49:27.434104 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:49:27.923165 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dfcb9cf0-a06b-4453-aa79-daa40a87c0d8 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "bac006c2-baff-4c37-8d24-8d4799d6583b" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.567s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:28.189954 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "ebcd1754-decd-470c-8d2f-1042b628a12f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:28.190252 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:28.450283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000b9a50607 for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:49:28.450786 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:28.450786 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (2036ms) {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:28.450951 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:49:28.453363 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:28.694322 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:49:28.790244 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:28.920125 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:28.956343 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Attempting to attach volume e08bd27e-dc7e-483b-9417-3238b78d1869 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] attach device xml: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: Jun 09 11:49:28.957281 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:49:29.270117 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:29.270369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:29.273817 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:49:29.274015 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Claim successful on node np0000002435 Jun 09 11:49:30.033466 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:30.163831 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:30.351823 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:30.640150 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:30.640373 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:30.640697 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:30.640863 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:3d:18:51, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:30.743290 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:30.933384 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:30.933619 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:30.937551 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:30.937551 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:30.937551 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:30.937551 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:30.937551 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:30.938773 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Terminating instance Jun 09 11:49:31.346988 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:31.347544 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:31.440599 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:31.447326 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:31.468839 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:31.473328 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:31.499359 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:31.665231 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:31.673196 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:31.749740 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-679bf90f-d342-4dcb-85da-58333cde3329 req-aa3e439b-db6f-49b3-b85b-3de136b673aa service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-unplugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:31.749740 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-679bf90f-d342-4dcb-85da-58333cde3329 req-aa3e439b-db6f-49b3-b85b-3de136b673aa service nova] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:31.750227 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-679bf90f-d342-4dcb-85da-58333cde3329 req-aa3e439b-db6f-49b3-b85b-3de136b673aa service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:31.750227 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-679bf90f-d342-4dcb-85da-58333cde3329 req-aa3e439b-db6f-49b3-b85b-3de136b673aa service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:31.750393 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-679bf90f-d342-4dcb-85da-58333cde3329 req-aa3e439b-db6f-49b3-b85b-3de136b673aa service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] No waiting events found dispatching network-vif-unplugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:31.750497 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-679bf90f-d342-4dcb-85da-58333cde3329 req-aa3e439b-db6f-49b3-b85b-3de136b673aa service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-unplugged-f0fa19df-5095-48ad-83e4-18358e1956aa for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:31.800880 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999646147000021 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:31.803658 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Instance destroyed successfully. Jun 09 11:49:31.806962 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'resources' on Instance uuid 2974c892-c8d4-41cc-93aa-1c4114c3538b {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:31.849495 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:49:31.949017 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.679s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:31.949877 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:49:32.209585 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-50b0dd00-a163-40cf-a4f9-69d1dfadc09f tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.545s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:32.310674 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1320416774',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-1320416774',id=14,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:48:10Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-hl0nxytd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:48:19Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=2974c892-c8d4-41cc-93aa-1c4114c3538b,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:32.310674 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "f0fa19df-5095-48ad-83e4-18358e1956aa", "address": "fa:16:3e:84:8e:25", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa19df-50", "ovs_interfaceid": "f0fa19df-5095-48ad-83e4-18358e1956aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:32.311183 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:32.312589 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:32.314569 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:32.314786 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0fa19df-50, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:32.317075 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:32.318213 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:32.319152 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:32.319402 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fbadc46-02c5-437f-975b-9fc2835ac4e1) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:32.321221 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:32.321303 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:32.324360 np0000002435 nova-compute[98325]: INFO os_vif [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:25,bridge_name='br-int',has_traffic_filtering=True,id=f0fa19df-5095-48ad-83e4-18358e1956aa,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa19df-50') Jun 09 11:49:32.324658 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Deleting instance files /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b_del Jun 09 11:49:32.325858 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Deletion of /opt/stack/data/nova/instances/2974c892-c8d4-41cc-93aa-1c4114c3538b_del complete Jun 09 11:49:32.414159 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:32.414650 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:32.419825 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:49:32.419944 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Claim successful on node np0000002435 Jun 09 11:49:32.460019 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:49:32.460019 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:49:32.460802 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:32.461679 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:32.746246 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3014eb93944045468f25c84897e09e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4846fa228b4be9829a4e85eabc18a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:49:32.836190 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Took 1.39 seconds to destroy the instance on the hypervisor. Jun 09 11:49:32.837001 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:32.838392 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:32.838552 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:32.838818 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:32.964661 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:49:33.006929 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:33.157795 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:33.158041 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:33.174125 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:33.226014 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00036493599986897607 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.226014 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.226160 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.1729891420000058 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.226202 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.17287201299996013 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.228854 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:33.229055 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] VM Stopped (Lifecycle Event) Jun 09 11:49:33.399557 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00044786700004806335 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.399724 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.400168 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=13.400349631999916 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.400325 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=13.400163161999899 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:33.401210 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:33.401360 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] VM Stopped (Lifecycle Event) Jun 09 11:49:33.405915 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Successfully created port: 81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:49:33.468595 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:49:33.620246 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Stashing vm_state: active {{(pid=98325) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 09 11:49:33.660231 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:49:33.719841 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Refreshing inventories for resource provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jun 09 11:49:33.731743 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: bac006c2-baff-4c37-8d24-8d4799d6583b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:33.790092 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Updating ProviderTree inventory for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jun 09 11:49:33.790224 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Updating inventory in ProviderTree for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 09 11:49:33.825501 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-unplugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:33.826053 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] Acquiring lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:33.826369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:33.826668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:33.826954 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] No waiting events found dispatching network-vif-unplugged-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:33.827223 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-unplugged-f0fa19df-5095-48ad-83e4-18358e1956aa for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:33.827450 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Received event network-vif-deleted-f0fa19df-5095-48ad-83e4-18358e1956aa {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:33.827670 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Neutron deleted interface f0fa19df-5095-48ad-83e4-18358e1956aa; detaching it from the instance and deleting it from the info cache Jun 09 11:49:33.832168 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b69ed54-ba8e-4211-a7b4-2951f3ba5ba3 req-e3b6d61d-3980-4ea4-9a81-f27b9f52ed18 service nova] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Detach interface failed, port_id=f0fa19df-5095-48ad-83e4-18358e1956aa, reason: Instance 2974c892-c8d4-41cc-93aa-1c4114c3538b could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:49:33.849239 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Refreshing aggregate associations for resource provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0, aggregates: None {{(pid=98325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jun 09 11:49:33.907608 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-eff775e9-9e2e-4ab2-ac73-ef73354b1181 tempest-TestMultiAttachVolumeSwap-911853440 tempest-TestMultiAttachVolumeSwap-911853440-project-member] [instance: f973e06e-5d44-4393-abce-509f80f2db62] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:33.910453 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Refreshing trait associations for resource provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_VIRTIO_FS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_STORAGE_BUS_USB {{(pid=98325) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jun 09 11:49:34.171004 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Successfully updated port: 81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:49:34.215701 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:34.227226 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:34.252207 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:34.260028 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:34.270791 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Received event network-changed-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:34.270791 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Refreshing instance network info cache due to event network-changed-81cad977-ef4b-41ff-8601-94cfa9804e73. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:49:34.270946 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] Acquiring lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:34.274459 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] Acquired lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:34.275966 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Refreshing network info cache for port 81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:49:34.483260 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:49:34.485307 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:49:34.486441 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Creating image(s) Jun 09 11:49:34.486441 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:34.486956 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "/opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:34.491164 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "/opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.004s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:34.491957 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:34.499698 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:34.505508 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:34.621361 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.116s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:34.622149 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:34.622859 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:34.623538 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:34.629852 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:34.630965 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:34.676678 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:34.707968 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:34.708581 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:34.729790 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Took 1.89 seconds to deallocate network for instance. Jun 09 11:49:34.745836 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.115s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:34.746343 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:34.784561 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:34.809616 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk 1073741824" returned: 0 in 0.063s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:34.813799 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.191s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:34.814168 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:34.917330 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.103s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:34.921486 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:49:34.921486 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:35.031285 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:49:35.042687 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:35.044762 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Cannot resize image /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:49:35.044762 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:49:35.044762 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Ensure instance console log exists: /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:49:35.044762 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:35.044762 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:35.044762 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:35.218498 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:35.240562 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:35.324715 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:35.353176 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:35.726255 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.311s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:35.726255 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:49:35.730182 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.514s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:35.826635 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-db01fe0a-6b5c-4b43-861d-2fe8dfdfe371 req-981fed79-b87a-43e7-b0ea-3d6e5eb65afa service nova] Releasing lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:35.827161 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquired lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:35.827386 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:36.236591 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:49:36.236591 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:49:36.236591 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:36.236591 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:36.245967 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:49:36.246587 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Claim successful on node np0000002435 Jun 09 11:49:36.361288 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f77769f25d754bdb997c3cdf5b5e46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8357a877b64741ce827b8108c288a358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:49:36.441190 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:49:36.743798 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:49:36.756852 np0000002435 nova-compute[98325]: INFO nova.compute.resource_tracker [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating resource usage from migration d28b3f9b-49d8-4f2f-bb91-e2ee7950b628 Jun 09 11:49:36.971251 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Successfully created port: c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:49:37.244223 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:49:37.320819 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:37.395801 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:37.456828 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:37.468099 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:37.468590 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:37.626188 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Updating instance_info_cache with network_info: [{"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:37.698000 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Successfully updated port: c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:49:37.766051 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-changed-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:37.769331 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Refreshing instance network info cache due to event network-changed-c70b4955-6289-438a-b45b-85c8c2c612b6. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:49:37.769331 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] Acquiring lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:37.769331 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] Acquired lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:37.769331 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Refreshing network info cache for port c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:49:37.973674 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:38.129167 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Releasing lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:38.129829 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Instance network_info: |[{"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:49:38.131709 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Start _get_guest_xml network_info=[{"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:49:38.133819 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:49:38.135005 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-952830858', uuid='ebcd1754-decd-470c-8d2f-1042b628a12f'), owner=OwnerMeta(userid='3014eb93944045468f25c84897e09e9d', username='tempest-ServerActionsTestOtherA-292149515-project-member', projectid='2e4846fa228b4be9829a4e85eabc18a2', projectname='tempest-ServerActionsTestOtherA-292149515'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005778.1346548) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:49:38.136011 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:49:38.136408 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:49:38.137535 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:49:38.137781 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:49:38.140010 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:49:38.140162 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:49:38.140330 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:49:38.141148 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:49:38.141148 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:49:38.141447 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:49:38.141551 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:49:38.141784 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:49:38.141897 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:49:38.142110 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:49:38.142229 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:49:38.142401 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:49:38.154914 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-952830858',display_name='tempest-ServerActionsTestOtherA-server-952830858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestothera-server-952830858',id=20,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVPEzFQpEp/kDJ3Z9DSbFuFNhzm54jtbHdE80oWwAp/hrTSuS3jTunAgF1JeybEYAFHqFC7ds5NyzQgSHWYfrSCDUQjO9BDEmjstCdnDcX582eXI5WmPicfY/hZpF249w==',key_name='tempest-keypair-2002726697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-6fa96ffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=ebcd1754-decd-470c-8d2f-1042b628a12f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:49:38.155152 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:38.155656 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:64:41,bridge_name='br-int',has_traffic_filtering=True,id=81cad977-ef4b-41ff-8601-94cfa9804e73,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81cad977-ef') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:38.156180 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'pci_devices' on Instance uuid ebcd1754-decd-470c-8d2f-1042b628a12f {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:38.201420 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:38.257891 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:49:38.258844 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:49:38.259179 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Creating image(s) Jun 09 11:49:38.259610 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:38.259788 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:38.260458 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:38.260978 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:38.264862 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:38.266211 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:38.280144 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:38.352284 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.086s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:38.352806 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:38.353249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:38.353750 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:38.357786 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:38.358254 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:38.394373 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:49:38.460855 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.103s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:38.461243 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:38.492039 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.239s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:38.494387 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.762s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:38.494549 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Migrating Jun 09 11:49:38.494909 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:49:38.505469 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:49:38.505562 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Claim successful on node np0000002435 Jun 09 11:49:38.531460 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk 1073741824" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:38.534776 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.181s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:38.537980 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:38.630168 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.094s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:38.632930 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:38.634363 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:49:38.634673 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] End _get_guest_xml xml= Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: ebcd1754-decd-470c-8d2f-1042b628a12f Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: instance-00000014 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 196608 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-server-952830858 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 2026-06-09 11:49:38 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 192 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: True Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: bare Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-292149515-project-member Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-292149515 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: ebcd1754-decd-470c-8d2f-1042b628a12f Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: ebcd1754-decd-470c-8d2f-1042b628a12f Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: hvm Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 128 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: Jun 09 11:49:38.672126 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:49:38.677416 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Preparing to wait for external event network-vif-plugged-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:49:38.677416 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:38.677416 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:38.677416 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:38.677416 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-952830858',display_name='tempest-ServerActionsTestOtherA-server-952830858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serveractionstestothera-server-952830858',id=20,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVPEzFQpEp/kDJ3Z9DSbFuFNhzm54jtbHdE80oWwAp/hrTSuS3jTunAgF1JeybEYAFHqFC7ds5NyzQgSHWYfrSCDUQjO9BDEmjstCdnDcX582eXI5WmPicfY/hZpF249w==',key_name='tempest-keypair-2002726697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-6fa96ffq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=ebcd1754-decd-470c-8d2f-1042b628a12f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:49:38.677835 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:38.677835 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:64:41,bridge_name='br-int',has_traffic_filtering=True,id=81cad977-ef4b-41ff-8601-94cfa9804e73,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81cad977-ef') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:38.677835 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:64:41,bridge_name='br-int',has_traffic_filtering=True,id=81cad977-ef4b-41ff-8601-94cfa9804e73,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81cad977-ef') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:49:38.679104 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:38.679536 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:38.679975 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:49:38.683477 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:38.683712 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08c297be-843e-5a16-b35f-b1033a18c205', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:38.685430 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:38.688522 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:38.692472 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:38.692797 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81cad977-ef, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:38.693450 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81cad977-ef, col_values=(('qos', UUID('5ee2f068-1a1d-4f12-a521-f58c4607a995')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:38.694473 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81cad977-ef, col_values=(('external_ids', {'iface-id': '81cad977-ef4b-41ff-8601-94cfa9804e73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:64:41', 'vm-uuid': 'ebcd1754-decd-470c-8d2f-1042b628a12f'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:38.695877 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:38.696924 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:38.706520 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:38.715029 np0000002435 nova-compute[98325]: INFO os_vif [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:64:41,bridge_name='br-int',has_traffic_filtering=True,id=81cad977-ef4b-41ff-8601-94cfa9804e73,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81cad977-ef') Jun 09 11:49:38.732476 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:38.733164 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Cannot resize image /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:49:38.734032 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:49:38.734226 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Ensure instance console log exists: /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:49:38.738525 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:38.738923 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:38.739062 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:39.038860 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:39.039417 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:39.039417 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:39.136460 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3ba7de9f-da3d-40a2-9fc3-3a83a5983000 req-a7a75ac6-dcb0-4e67-a2a0-2dc0b203c65b service nova] Releasing lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:39.136591 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:39.136760 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:39.449747 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:39.546661 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:39.775281 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:49:40.042119 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:40.160002 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:40.238353 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:40.238353 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:40.238353 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No VIF found with MAC fa:16:3e:c1:64:41, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:40.238598 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Using config drive Jun 09 11:49:40.359784 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:40.402467 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Updating instance_info_cache with network_info: [{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:40.463883 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:40.464153 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:40.492292 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:40.748872 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:40.904618 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:40.904961 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance network_info: |[{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:49:40.907501 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Start _get_guest_xml network_info=[{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:49:40.909689 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:49:40.911354 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-347303546', uuid='5e03b1ab-e8ab-4fbe-8171-33617997b734'), owner=OwnerMeta(userid='f77769f25d754bdb997c3cdf5b5e46e4', username='tempest-ServerRescueNegativeTestJSON-1703040470-project-member', projectid='8357a877b64741ce827b8108c288a358', projectname='tempest-ServerRescueNegativeTestJSON-1703040470'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005780.9108818) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:49:40.912535 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:49:40.913105 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:49:40.916898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:49:40.917629 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:49:40.917876 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:49:40.918149 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:49:40.934784 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-347303546',display_name='tempest-ServerRescueNegativeTestJSON-server-347303546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-347303546',id=21,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-1cder433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:37Z,user_data=None,user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=5e03b1ab-e8ab-4fbe-8171-33617997b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:49:40.935847 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:40.936165 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:4e:7a,bridge_name='br-int',has_traffic_filtering=True,id=c70b4955-6289-438a-b45b-85c8c2c612b6,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70b4955-62') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:40.939365 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:40.965074 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Creating config drive at /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk.config Jun 09 11:49:40.971514 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:40.985040 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4fjs2o4y {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:41.007495 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:41.048979 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4fjs2o4y" returned: 0 in 0.064s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] End _get_guest_xml xml= Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 5e03b1ab-e8ab-4fbe-8171-33617997b734 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: instance-00000015 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 196608 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-server-347303546 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 2026-06-09 11:49:40 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 192 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: True Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: bare Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470-project-member Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 5e03b1ab-e8ab-4fbe-8171-33617997b734 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 5e03b1ab-e8ab-4fbe-8171-33617997b734 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: hvm Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 128 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: Jun 09 11:49:41.442969 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:49:41.444698 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Preparing to wait for external event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:49:41.444698 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:41.444698 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:41.444698 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:41.444698 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-347303546',display_name='tempest-ServerRescueNegativeTestJSON-server-347303546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-347303546',id=21,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-1cder433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:37Z,user_data=None,user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=5e03b1ab-e8ab-4fbe-8171-33617997b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:49:41.444954 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:41.445640 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:4e:7a,bridge_name='br-int',has_traffic_filtering=True,id=c70b4955-6289-438a-b45b-85c8c2c612b6,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70b4955-62') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:41.445903 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:4e:7a,bridge_name='br-int',has_traffic_filtering=True,id=c70b4955-6289-438a-b45b-85c8c2c612b6,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70b4955-62') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:49:41.446524 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.448788 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:41.449196 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:49:41.451173 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.451625 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '966a4d79-541a-5952-8330-2971c843b6ee', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:41.454823 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.457534 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:41.460753 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.464207 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.464856 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc70b4955-62, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:41.465539 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc70b4955-62, col_values=(('qos', UUID('438b5292-8c2a-4a40-8043-d3aa9c8e1aa9')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:41.465802 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc70b4955-62, col_values=(('external_ids', {'iface-id': 'c70b4955-6289-438a-b45b-85c8c2c612b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:4e:7a', 'vm-uuid': '5e03b1ab-e8ab-4fbe-8171-33617997b734'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:41.468135 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.470184 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:41.482630 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.484017 np0000002435 nova-compute[98325]: INFO os_vif [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:4e:7a,bridge_name='br-int',has_traffic_filtering=True,id=c70b4955-6289-438a-b45b-85c8c2c612b6,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70b4955-62') Jun 09 11:49:41.486867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.996s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:41.489102 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.248s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:41.489540 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:49:41.663358 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.664684 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.704096 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.742712 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:41.996803 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:49:41.997066 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:49:41.997512 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:41.997812 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:42.053418 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.060470 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.062105 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.090472 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.091950 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.132783 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f77769f25d754bdb997c3cdf5b5e46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8357a877b64741ce827b8108c288a358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:49:42.268814 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:42.269103 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:42.313183 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bdbf13ae-1750-4dbd-b137-10d7dc2da990 req-6b0a9b41-f187-457c-adad-d861705c2d4d service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Received event network-vif-plugged-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:42.314400 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bdbf13ae-1750-4dbd-b137-10d7dc2da990 req-6b0a9b41-f187-457c-adad-d861705c2d4d service nova] Acquiring lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:42.316909 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bdbf13ae-1750-4dbd-b137-10d7dc2da990 req-6b0a9b41-f187-457c-adad-d861705c2d4d service nova] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:42.320752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bdbf13ae-1750-4dbd-b137-10d7dc2da990 req-6b0a9b41-f187-457c-adad-d861705c2d4d service nova] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:42.320752 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bdbf13ae-1750-4dbd-b137-10d7dc2da990 req-6b0a9b41-f187-457c-adad-d861705c2d4d service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Processing event network-vif-plugged-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:49:42.501648 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:49:42.534693 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Starting migrate_disk_and_power_off {{(pid=98325) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12626}} Jun 09 11:49:42.567098 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.572064 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.595939 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.723111 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:42.723111 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] VM Started (Lifecycle Event) Jun 09 11:49:42.727049 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:49:42.732192 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:49:42.748336 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Instance spawned successfully. Jun 09 11:49:42.748336 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:49:42.771207 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.774920 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:42.784473 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.796575 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Successfully created port: b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:49:42.870106 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.893986 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.903994 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance destroyed successfully. Jun 09 11:49:42.907874 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=17,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:45Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-je49h29z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=b6f3bff5-5831-44df-8fb2-55bb82329aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:42.907874 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:42.908206 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:42.908625 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:42.913182 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.913541 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7556c29-41, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:42.916419 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.917193 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:42.928328 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.930512 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.930801 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3b61e2b-8f5b-4454-bb5c-44ef84a3130d) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:42.932098 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.932608 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:42.939771 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:42.942711 np0000002435 nova-compute[98325]: INFO os_vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') Jun 09 11:49:43.008301 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:49:43.024365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:43.024365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:43.024365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:77:4e:7a, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:43.024365 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Using config drive Jun 09 11:49:43.229183 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:43.231432 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:43.260898 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:43.261096 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:43.261496 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:43.261673 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:43.261942 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:43.262200 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:43.287621 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.800s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:43.370799 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Deleted allocations for instance 2974c892-c8d4-41cc-93aa-1c4114c3538b Jun 09 11:49:43.491302 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Detected multiple connections on this host for volume: e08bd27e-dc7e-483b-9417-3238b78d1869, skipping target disconnect. Jun 09 11:49:43.497862 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:43.537453 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:43.577739 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Successfully updated port: b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:49:43.615383 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:43.619292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:43.653096 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-changed-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:43.653096 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Refreshing instance network info cache due to event network-changed-b0c3f8af-0e22-4133-a923-1b17070d3178. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:49:43.653824 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] Acquiring lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:43.653931 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] Acquired lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:43.654129 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Refreshing network info cache for port b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:49:43.673734 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-269eb4d1-4fef-4e07-a369-c4ed8d4b0978 req-c76aa59d-bedd-4927-8e98-ce7bc5af6198 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:43.674786 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-269eb4d1-4fef-4e07-a369-c4ed8d4b0978 req-c76aa59d-bedd-4927-8e98-ce7bc5af6198 service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:43.675325 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-269eb4d1-4fef-4e07-a369-c4ed8d4b0978 req-c76aa59d-bedd-4927-8e98-ce7bc5af6198 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:43.675325 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-269eb4d1-4fef-4e07-a369-c4ed8d4b0978 req-c76aa59d-bedd-4927-8e98-ce7bc5af6198 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:43.678025 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-269eb4d1-4fef-4e07-a369-c4ed8d4b0978 req-c76aa59d-bedd-4927-8e98-ce7bc5af6198 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No event matching network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 in dict_keys([('network-vif-plugged', 'c70b4955-6289-438a-b45b-85c8c2c612b6')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:49:43.678287 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-269eb4d1-4fef-4e07-a369-c4ed8d4b0978 req-c76aa59d-bedd-4927-8e98-ce7bc5af6198 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state building and task_state spawning. Jun 09 11:49:43.727369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:43.727795 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:49:43.728576 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab_resize/disk /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:43.749218 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:49:43.749908 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:43.750715 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] VM Paused (Lifecycle Event) Jun 09 11:49:43.774468 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Took 9.29 seconds to spawn the instance on the hypervisor. Jun 09 11:49:43.780365 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:43.850136 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Creating config drive at /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config Jun 09 11:49:43.851660 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "cp -r /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab_resize/disk /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk" returned: 0 in 0.123s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:43.856449 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab_resize/disk.config /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:43.889533 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp12mdkc70 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:43.901305 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "cp -r /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab_resize/disk.config /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config" returned: 0 in 0.048s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:43.902326 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab_resize/disk.info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:43.940143 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "cp -r /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab_resize/disk.info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" returned: 0 in 0.038s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:43.947147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp12mdkc70" returned: 0 in 0.058s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:44.038468 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:49:44.040434 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:49:44.040766 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Creating image(s) Jun 09 11:49:44.041387 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:44.042744 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:44.044226 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:44.045915 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:44.050678 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:44.055155 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:44.085015 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:44.157653 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.102s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:44.158145 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:44.159100 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:44.163795 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.006s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:44.165401 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:44.168511 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:44.168996 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:44.255530 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:44.260289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.091s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:44.261481 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:44.278067 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:44.278378 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] VM Resumed (Lifecycle Event) Jun 09 11:49:44.291616 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:49:44.302313 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Took 15.11 seconds to build instance. Jun 09 11:49:44.318974 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk 1073741824" returned: 0 in 0.057s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:44.320097 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.156s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:44.320489 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:44.391651 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-c0c44689-25b2-486e-aaea-2b1e29f97013 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "2974c892-c8d4-41cc-93aa-1c4114c3538b" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 13.456s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:44.421446 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5f8a1549-94d3-424c-8cde-7c7f9499e77b req-20c09fac-1f20-46fe-b595-f1a7dfb3b120 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Received event network-vif-plugged-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:44.425614 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.104s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:44.426032 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:49:44.426353 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:44.447191 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5f8a1549-94d3-424c-8cde-7c7f9499e77b req-20c09fac-1f20-46fe-b595-f1a7dfb3b120 service nova] Acquiring lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:44.447879 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5f8a1549-94d3-424c-8cde-7c7f9499e77b req-20c09fac-1f20-46fe-b595-f1a7dfb3b120 service nova] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.022s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:44.448066 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5f8a1549-94d3-424c-8cde-7c7f9499e77b req-20c09fac-1f20-46fe-b595-f1a7dfb3b120 service nova] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:44.448345 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5f8a1549-94d3-424c-8cde-7c7f9499e77b req-20c09fac-1f20-46fe-b595-f1a7dfb3b120 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] No waiting events found dispatching network-vif-plugged-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:44.448516 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5f8a1549-94d3-424c-8cde-7c7f9499e77b req-20c09fac-1f20-46fe-b595-f1a7dfb3b120 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Received unexpected event network-vif-plugged-81cad977-ef4b-41ff-8601-94cfa9804e73 for instance with vm_state active and task_state None. Jun 09 11:49:44.454972 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:44.488433 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:44.543282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:44.543670 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Cannot resize image /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:49:44.543991 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:49:44.544149 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Ensure instance console log exists: /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:49:44.544457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:44.544612 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:44.544730 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:44.576754 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:44.794719 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:44.800178 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:44.806842 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dbe6aa5a-db4b-48f8-822c-77d0f5ffabfd tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "ebcd1754-decd-470c-8d2f-1042b628a12f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.616s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:44.921125 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:44.929495 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:44.939409 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:44.961704 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:45.201771 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:45.202912 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:45.280380 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Port e7556c29-4189-4614-a64c-3b34768b7ad8 binding to destination host np0000002435 is already ACTIVE {{(pid=98325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 09 11:49:45.305687 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999653569999964 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:45.361580 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:45.451135 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5807e1c8-d58c-4533-9766-b8c84eab2072 req-a69ba455-8834-4021-8ce0-849f34bbc1cb service nova] Releasing lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:45.451582 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:45.451800 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:45.544581 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:45.544872 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Started (Lifecycle Event) Jun 09 11:49:45.561045 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:45.561294 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:45.561572 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:45.561745 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:45.562808 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:45.565589 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Terminating instance Jun 09 11:49:45.735721 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Received event network-changed-81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:45.735886 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Refreshing instance network info cache due to event network-changed-81cad977-ef4b-41ff-8601-94cfa9804e73. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:49:45.736086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] Acquiring lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:45.736198 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] Acquired lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:45.736608 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Refreshing network info cache for port 81cad977-ef4b-41ff-8601-94cfa9804e73 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:49:46.025080 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:49:46.050648 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:46.052722 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:46.052821 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Paused (Lifecycle Event) Jun 09 11:49:46.071142 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:46.091083 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.098446 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.123712 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.241298 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:46.244683 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.287499 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:49:46.302293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:46.302293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:46.302293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:46.302293 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.310590 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.313592 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:46.376666 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.383937 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.408201 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Instance destroyed successfully. Jun 09 11:49:46.410390 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'resources' on Instance uuid c2f05fbe-de86-4378-8aa5-c047f02ac7b9 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:46.555053 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:46.561554 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:46.631461 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Updating instance_info_cache with network_info: [{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:46.800905 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00038530899996658263 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:46.801011 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:46.801108 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=13.503766564999978 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:46.801173 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=13.503696383000033 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:46.802151 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:46.802385 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] VM Stopped (Lifecycle Event) Jun 09 11:49:46.837874 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:46.919411 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:47:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-718577859',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-718577859',id=11,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:47:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-90li3eum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:55Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=c2f05fbe-de86-4378-8aa5-c047f02ac7b9,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:46.919719 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "address": "fa:16:3e:54:c9:62", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap930eb8bb-2d", "ovs_interfaceid": "930eb8bb-2d85-44fe-a9ed-6d0e6885242e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:46.920320 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:46.920587 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:46.922849 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.923126 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap930eb8bb-2d, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:46.924016 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.924717 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:46.925174 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.926226 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.926392 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e331b6c-9d32-440f-a1a9-8b4860b9e474) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:46.926859 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.927277 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:46.928752 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:46.932240 np0000002435 nova-compute[98325]: INFO os_vif [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c9:62,bridge_name='br-int',has_traffic_filtering=True,id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap930eb8bb-2d') Jun 09 11:49:46.933522 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:49:46.933869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:46.934017 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:46.934450 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:46.934808 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:49:46.934934 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:46.964399 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39 (non-flash) Jun 09 11:49:46.964745 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:46.964979 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:49:46.964979 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '5')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:46.967319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39', '6')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:49:46.968612 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Resulting device map defaultdict(. at 0x77d8e0437560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'): ({'sde'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:49:46.968815 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Removing multipathed devices sdd, sde {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:49:46.969384 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Flush multipath device 33000000058f02a3c {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:49:47.019115 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:47.063366 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Updated VIF entry in instance network info cache for port 81cad977-ef4b-41ff-8601-94cfa9804e73. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:49:47.064167 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] [instance: ebcd1754-decd-470c-8d2f-1042b628a12f] Updating instance_info_cache with network_info: [{"id": "81cad977-ef4b-41ff-8601-94cfa9804e73", "address": "fa:16:3e:c1:64:41", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81cad977-ef", "ovs_interfaceid": "81cad977-ef4b-41ff-8601-94cfa9804e73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:47.065605 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:49:47.067440 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999697353000101 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:47.067989 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:49:47.115912 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:49:47.116084 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:49:47.117590 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:49:47.132042 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:49:47.132340 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:49:47.133915 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:47.134183 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance network_info: |[{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:49:47.135737 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Start _get_guest_xml network_info=[{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:49:47.144603 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:49:47.144937 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-717859707', uuid='15ac82d8-f625-48e9-9dee-26835f0cc136'), owner=OwnerMeta(userid='f77769f25d754bdb997c3cdf5b5e46e4', username='tempest-ServerRescueNegativeTestJSON-1703040470-project-member', projectid='8357a877b64741ce827b8108c288a358', projectname='tempest-ServerRescueNegativeTestJSON-1703040470'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005787.1444545) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:49:47.147217 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:47.149857 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:49:47.150244 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:49:47.150992 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:49:47.151162 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:49:47.152081 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:49:47.152465 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:49:47.152617 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:49:47.152711 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:49:47.152816 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:49:47.152889 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:49:47.153019 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:49:47.153164 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:49:47.153356 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:49:47.153461 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:49:47.153585 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:49:47.153725 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:49:47.164682 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717859707',display_name='tempest-ServerRescueNegativeTestJSON-server-717859707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-717859707',id=22,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-50m5rowm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:43Z,user_data=None,user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=15ac82d8-f625-48e9-9dee-26835f0cc136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:49:47.164921 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:47.165555 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ca:96,bridge_name='br-int',has_traffic_filtering=True,id=b0c3f8af-0e22-4133-a923-1b17070d3178,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c3f8af-0e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:47.166174 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:47.184398 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.40.100,3260] Jun 09 11:49:47.184398 np0000002435 nova-compute[98325]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.40.100,3260] successful. Jun 09 11:49:47.184398 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:47.201051 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:47.220996 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:47.267516 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.50.100,3260] Jun 09 11:49:47.267516 np0000002435 nova-compute[98325]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-70e2a824-5ff4-43e3-90b1-eb8fe3827f39, portal: 192.168.50.100,3260] successful. Jun 09 11:49:47.267516 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:47.290282 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:47.290282 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:47.290282 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] <== disconnect_volume: return (355ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:47.290282 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:49:47.290282 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Deleting instance files /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9_del Jun 09 11:49:47.290648 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Deletion of /opt/stack/data/nova/instances/c2f05fbe-de86-4378-8aa5-c047f02ac7b9_del complete Jun 09 11:49:47.305591 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 2974c892-c8d4-41cc-93aa-1c4114c3538b] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:47.316024 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:47.434114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:47.434309 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:47.434464 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:47.567173 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-739e738d-8901-47af-898a-5b1bd64584d5 req-8524f1b1-8b00-4beb-9177-d4ac615b5441 service nova] Releasing lock "refresh_cache-ebcd1754-decd-470c-8d2f-1042b628a12f" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] End _get_guest_xml xml= Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 15ac82d8-f625-48e9-9dee-26835f0cc136 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: instance-00000016 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 196608 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-server-717859707 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 2026-06-09 11:49:47 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 192 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: True Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: bare Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 0 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: virtio Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470-project-member Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 15ac82d8-f625-48e9-9dee-26835f0cc136 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 15ac82d8-f625-48e9-9dee-26835f0cc136 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: hvm Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 128 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: 1 Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: Jun 09 11:49:47.669754 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:49:47.671779 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Preparing to wait for external event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:49:47.671779 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:47.671779 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:47.671779 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:47.671779 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717859707',display_name='tempest-ServerRescueNegativeTestJSON-server-717859707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-717859707',id=22,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-50m5rowm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:43Z,user_data=None,user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=15ac82d8-f625-48e9-9dee-26835f0cc136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:49:47.671986 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:47.671986 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ca:96,bridge_name='br-int',has_traffic_filtering=True,id=b0c3f8af-0e22-4133-a923-1b17070d3178,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c3f8af-0e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:47.671986 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ca:96,bridge_name='br-int',has_traffic_filtering=True,id=b0c3f8af-0e22-4133-a923-1b17070d3178,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c3f8af-0e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:49:47.672396 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.672640 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:47.672847 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:49:47.673726 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.673944 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20ea5c55-715a-583b-8fbf-5e60dedb8ae3', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:47.675150 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.675787 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:47.677936 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.680379 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.680664 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0c3f8af-0e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:47.681177 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0c3f8af-0e, col_values=(('qos', UUID('4a8c4620-7bb8-447d-b5d7-9b679840efdb')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:47.681271 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0c3f8af-0e, col_values=(('external_ids', {'iface-id': 'b0c3f8af-0e22-4133-a923-1b17070d3178', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:ca:96', 'vm-uuid': '15ac82d8-f625-48e9-9dee-26835f0cc136'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:47.682248 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.685431 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:47.691028 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:47.692249 np0000002435 nova-compute[98325]: INFO os_vif [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:ca:96,bridge_name='br-int',has_traffic_filtering=True,id=b0c3f8af-0e22-4133-a923-1b17070d3178,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c3f8af-0e') Jun 09 11:49:47.798446 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Took 1.73 seconds to destroy the instance on the hypervisor. Jun 09 11:49:47.799110 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:47.799447 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:47.799555 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:47.799809 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:47.936563 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:47.950876 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:48.269214 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:48.402302 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d734bc7f-ad1e-4f0c-8f10-375101fb5f37 req-191ba210-fe57-4954-a6df-d54d826abe29 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Received event network-vif-deleted-930eb8bb-2d85-44fe-a9ed-6d0e6885242e {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:48.402758 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-d734bc7f-ad1e-4f0c-8f10-375101fb5f37 req-191ba210-fe57-4954-a6df-d54d826abe29 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Neutron deleted interface 930eb8bb-2d85-44fe-a9ed-6d0e6885242e; detaching it from the instance and deleting it from the info cache Jun 09 11:49:48.406885 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d734bc7f-ad1e-4f0c-8f10-375101fb5f37 req-191ba210-fe57-4954-a6df-d54d826abe29 service nova] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Detach interface failed, port_id=930eb8bb-2d85-44fe-a9ed-6d0e6885242e, reason: Instance c2f05fbe-de86-4378-8aa5-c047f02ac7b9 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:49:48.719799 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:48.818108 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:48.864756 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:49.211594 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:49.211732 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:49:49.211835 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:eb:ca:96, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:49:49.212254 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Using config drive Jun 09 11:49:49.319947 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Took 1.52 seconds to deallocate network for instance. Jun 09 11:49:49.366216 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:49.718013 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:49.881138 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:49.893411 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Creating config drive at /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.config Jun 09 11:49:49.895213 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:49:49.899448 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu8471ot4 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:49.914917 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Took 0.59 seconds to detach 1 volumes for instance. Jun 09 11:49:49.925781 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Deleting volume: 70e2a824-5ff4-43e3-90b1-eb8fe3827f39 {{(pid=98325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 09 11:49:49.931359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:49.961314 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu8471ot4" returned: 0 in 0.061s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:49.968513 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:49:49.970765 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:49:49.982833 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:49:49.984810 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe08:75ab', 'fe80::9413:f5ff:fe9e:1010', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::c87e:11ff:fe22:1ec1'] Jun 09 11:49:49.985080 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:49:49.985211 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:49:49.985521 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:49:50.364814 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:50.506061 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:50.514231 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:50.514498 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:50.529812 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:50.578908 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-38b467c7-9f53-491f-a87d-725fcc622b25 req-15646e11-a63b-43b7-a522-34020be2d556 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-vif-unplugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:50.580135 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-38b467c7-9f53-491f-a87d-725fcc622b25 req-15646e11-a63b-43b7-a522-34020be2d556 service nova] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:50.581234 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-38b467c7-9f53-491f-a87d-725fcc622b25 req-15646e11-a63b-43b7-a522-34020be2d556 service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:50.582908 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-38b467c7-9f53-491f-a87d-725fcc622b25 req-15646e11-a63b-43b7-a522-34020be2d556 service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:50.583093 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-38b467c7-9f53-491f-a87d-725fcc622b25 req-15646e11-a63b-43b7-a522-34020be2d556 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] No waiting events found dispatching network-vif-unplugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:50.583205 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-38b467c7-9f53-491f-a87d-725fcc622b25 req-15646e11-a63b-43b7-a522-34020be2d556 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received unexpected event network-vif-unplugged-e7556c29-4189-4614-a64c-3b34768b7ad8 for instance with vm_state active and task_state resize_finish. Jun 09 11:49:50.640699 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:50.696796 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:50.912864 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-adc4139d-8f49-4f04-a9b0-6d885d9f73ba req-f69893d3-69df-4f30-a07d-2d6a26a8f68c service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:50.914637 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-adc4139d-8f49-4f04-a9b0-6d885d9f73ba req-f69893d3-69df-4f30-a07d-2d6a26a8f68c service nova] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:50.914805 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-adc4139d-8f49-4f04-a9b0-6d885d9f73ba req-f69893d3-69df-4f30-a07d-2d6a26a8f68c service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:50.915062 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-adc4139d-8f49-4f04-a9b0-6d885d9f73ba req-f69893d3-69df-4f30-a07d-2d6a26a8f68c service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:50.915062 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-adc4139d-8f49-4f04-a9b0-6d885d9f73ba req-f69893d3-69df-4f30-a07d-2d6a26a8f68c service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Processing event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:49:51.196890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:51.196890 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:51.208119 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Starting finish_migration {{(pid=98325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12813}} Jun 09 11:49:51.210206 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:49:51.210686 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Creating image(s) Jun 09 11:49:51.211768 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:51.293216 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.081s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:51.293697 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:49:51.293955 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:51.376318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:51.376842 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Cannot resize image /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:49:51.388809 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:51.389364 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:49:51.389588 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] VM Started (Lifecycle Event) Jun 09 11:49:51.393701 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:49:51.395517 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance spawned successfully. Jun 09 11:49:51.396044 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:49:51.701108 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:51.880849 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:49:51.881032 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Ensure instance console log exists: /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:49:51.881321 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:51.881582 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:51.881720 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:51.886166 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Start _get_guest_xml network_info=[{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b6f3bff5-5831-44df-8fb2-55bb82329aab', 'attached_at': '2026-06-09T11:49:50.000000', 'detached_at': '', 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'multiattach': True, 'serial': 'e08bd27e-dc7e-483b-9417-3238b78d1869'}, 'attachment_id': 'c750461f-32d2-463b-9b7a-3b7055194b01', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:49:51.893942 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:51.894780 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:49:51.895963 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b6f3bff5-5831-44df-8fb2-55bb82329aab'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005791.895614) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:49:51.900250 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:51.904144 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:49:51.905374 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:49:51.906388 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:51.906701 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:51.907058 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:51.907424 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:51.907738 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:51.907997 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:51.910926 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:49:51.911220 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:49:51.912195 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:49:51.912542 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:49:51.912821 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:49:51.912927 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:49:51.913361 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:49:51.913361 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:49:51.913361 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:49:51.913361 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:49:51.913520 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:49:51.913631 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:49:51.913742 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:49:51.913820 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:49:51.929684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:52.026887 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:52.028002 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:52.028248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:52.028850 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:52.029171 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:49:52.029562 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:49:52.029726 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:52.030041 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:52.030293 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:49:52.043885 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:52.045454 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:49:52.046045 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:52.046237 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:49:52.046785 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:49:52.047371 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:52.060146 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:49:52.067198 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:52.073283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:52.086458 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:49:52.092361 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.092361 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.092361 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.092361 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.092361 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:52.092700 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.092700 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.092700 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.092700 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.092700 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:52.092862 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:52.092960 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:52.093530 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('13', '0', '0', 0) found on session 27 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:52.093647 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:52.104757 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.104757 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.104757 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.104757 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.104757 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:49:52.105548 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 27 and hctl ('13', '0', '0', 0) yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:52.105892 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.105892 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:49:52.105892 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.105892 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:49:52.105892 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:49:52.105892 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:52.107785 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:49:52.107785 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:49:52.107785 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('14', '0', '0', 0) found on session 28 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:49:52.107785 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:49:52.116868 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 28 and hctl ('14', '0', '0', 0) yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:49:52.117392 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:49:52.208749 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.694s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:52.265025 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Deleted allocations for instance c2f05fbe-de86-4378-8aa5-c047f02ac7b9 Jun 09 11:49:52.404016 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:49:52.405029 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:52.405180 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] VM Paused (Lifecycle Event) Jun 09 11:49:52.426903 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Took 8.39 seconds to spawn the instance on the hypervisor. Jun 09 11:49:52.427192 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:52.575569 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:52.684096 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:52.690801 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-vif-unplugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:52.692200 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:52.692285 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:52.692443 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:52.692609 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] No waiting events found dispatching network-vif-unplugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:52.692787 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received unexpected event network-vif-unplugged-e7556c29-4189-4614-a64c-3b34768b7ad8 for instance with vm_state active and task_state resize_finish. Jun 09 11:49:52.692904 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:52.693068 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:52.693212 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:52.693384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:52.693535 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Processing event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:49:52.693725 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:52.693890 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:52.694022 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:52.694275 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:52.695259 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:49:52.695259 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:52.695376 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-209c834e-31b0-49ba-bfe9-d331471a51dc req-ad01d139-2e2b-46a9-b803-bc5837d90f9b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state building and task_state spawning. Jun 09 11:49:52.701828 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:49:52.703185 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance spawned successfully. Jun 09 11:49:52.704398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:49:52.908536 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:52.910284 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:52.913473 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] VM Resumed (Lifecycle Event) Jun 09 11:49:52.939989 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Took 18.77 seconds to build instance. Jun 09 11:49:53.015887 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-74f81ca2-4848-4a05-b23c-dd829a5469e1 req-ae7d7c68-f526-414c-ae0b-61a839190cff service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:53.016039 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-74f81ca2-4848-4a05-b23c-dd829a5469e1 req-ae7d7c68-f526-414c-ae0b-61a839190cff service nova] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:53.016175 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-74f81ca2-4848-4a05-b23c-dd829a5469e1 req-ae7d7c68-f526-414c-ae0b-61a839190cff service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:53.016293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-74f81ca2-4848-4a05-b23c-dd829a5469e1 req-ae7d7c68-f526-414c-ae0b-61a839190cff service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:53.016410 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-74f81ca2-4848-4a05-b23c-dd829a5469e1 req-ae7d7c68-f526-414c-ae0b-61a839190cff service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] No waiting events found dispatching network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:53.017001 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-74f81ca2-4848-4a05-b23c-dd829a5469e1 req-ae7d7c68-f526-414c-ae0b-61a839190cff service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received unexpected event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 for instance with vm_state active and task_state None. Jun 09 11:49:53.047450 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:49:53.218980 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:53.219131 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:53.219534 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:53.219821 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:53.220095 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:53.220397 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:49:53.276141 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4db8f733-5070-4fdf-a9d2-bdf871c73968 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "c2f05fbe-de86-4378-8aa5-c047f02ac7b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.714s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:53.417636 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:53.425058 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:53.447804 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.290s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:53.728687 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Took 15.47 seconds to spawn the instance on the hypervisor. Jun 09 11:49:53.728687 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:53.926973 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:49:53.927494 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Resumed (Lifecycle Event) Jun 09 11:49:54.168493 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:54.168493 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:54.168742 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:54.168856 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:54.169068 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:54.171206 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Terminating instance Jun 09 11:49:54.243991 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Took 21.89 seconds to build instance. Jun 09 11:49:54.430730 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:49:54.432858 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:49:54.677251 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:49:54.699053 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:54.705187 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:54.710882 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Rescuing Jun 09 11:49:54.710882 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:49:54.710882 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:49:54.710882 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:49:54.734707 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:54.745904 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:54.747539 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.400s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:54.774540 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:54.777335 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:54.995021 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.033632 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.038870 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999667485999908 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:55.044656 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Instance destroyed successfully. Jun 09 11:49:55.046440 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lazy-loading 'resources' on Instance uuid 54835fc7-b0b9-4113-90ad-797bdac45590 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:55.181446 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d21e16bc-829d-4d05-8df1-485855dbe33c req-667b753d-35e5-4f56-bf71-2797af5e26c6 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:55.181778 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d21e16bc-829d-4d05-8df1-485855dbe33c req-667b753d-35e5-4f56-bf71-2797af5e26c6 service nova] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:55.181959 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d21e16bc-829d-4d05-8df1-485855dbe33c req-667b753d-35e5-4f56-bf71-2797af5e26c6 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:55.182084 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d21e16bc-829d-4d05-8df1-485855dbe33c req-667b753d-35e5-4f56-bf71-2797af5e26c6 service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:55.182207 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d21e16bc-829d-4d05-8df1-485855dbe33c req-667b753d-35e5-4f56-bf71-2797af5e26c6 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] No waiting events found dispatching network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:55.182381 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d21e16bc-829d-4d05-8df1-485855dbe33c req-667b753d-35e5-4f56-bf71-2797af5e26c6 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:55.212720 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:55.272834 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.368138 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.467631 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.476740 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.479385 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.517988 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.553086 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733231394',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverbootfromvolumestablerescuetest-server-733231394',id=1,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:46:59Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4b166f86497e4dbfb0ea7e1850584656',ramdisk_id='',reservation_id='r-kebpdl2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-252292105',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:47:09Z,user_data=None,user_id='ddbd75a95df64400a7a3db15ee91196e',uuid=54835fc7-b0b9-4113-90ad-797bdac45590,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:49:55.553232 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converting VIF {"id": "e5319a59-cd4b-4855-be1e-9107dd976810", "address": "fa:16:3e:08:75:ab", "network": {"id": "86bfa34f-775b-4f61-a6e2-f6a6de38f5fc", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-798927641-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b166f86497e4dbfb0ea7e1850584656", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5319a59-cd", "ovs_interfaceid": "e5319a59-cd4b-4855-be1e-9107dd976810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:49:55.553899 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:49:55.554702 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:49:55.557945 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.557945 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5319a59-cd, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:55.561641 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:55.565631 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.565844 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86ccf1aa-86f3-4723-bdfe-901d639c86c5) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:49:55.567767 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:49:55.571207 np0000002435 nova-compute[98325]: INFO os_vif [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:75:ab,bridge_name='br-int',has_traffic_filtering=True,id=e5319a59-cd4b-4855-be1e-9107dd976810,network=Network(86bfa34f-775b-4f61-a6e2-f6a6de38f5fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5319a59-cd') Jun 09 11:49:55.571721 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Deleting instance files /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590_del Jun 09 11:49:55.572683 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Deletion of /opt/stack/data/nova/instances/54835fc7-b0b9-4113-90ad-797bdac45590_del complete Jun 09 11:49:55.640184 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.671023 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:55.941319 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:56.082290 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Took 1.40 seconds to destroy the instance on the hypervisor. Jun 09 11:49:56.083179 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:49:56.083510 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:49:56.083620 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:49:56.084106 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:56.159733 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Updating instance_info_cache with network_info: [{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:56.196161 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:49:56.664450 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-15ac82d8-f625-48e9-9dee-26835f0cc136" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:49:56.696643 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2035b113-45c7-4436-98b3-8b6152a41d84 req-44972dc3-7755-4ca7-90c5-3c8c97708614 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-deleted-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:56.696643 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-2035b113-45c7-4436-98b3-8b6152a41d84 req-44972dc3-7755-4ca7-90c5-3c8c97708614 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Neutron deleted interface e5319a59-cd4b-4855-be1e-9107dd976810; detaching it from the instance and deleting it from the info cache Jun 09 11:49:56.700745 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2035b113-45c7-4436-98b3-8b6152a41d84 req-44972dc3-7755-4ca7-90c5-3c8c97708614 service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Detach interface failed, port_id=e5319a59-cd4b-4855-be1e-9107dd976810, reason: Instance 54835fc7-b0b9-4113-90ad-797bdac45590 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:49:57.044025 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:49:57.267995 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5cd04f3f-0981-4f82-aec7-9fc612271ee5 req-67fc5604-26c2-4c9c-92fb-f6d74966738b service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:57.268559 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5cd04f3f-0981-4f82-aec7-9fc612271ee5 req-67fc5604-26c2-4c9c-92fb-f6d74966738b service nova] Acquiring lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:57.268559 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5cd04f3f-0981-4f82-aec7-9fc612271ee5 req-67fc5604-26c2-4c9c-92fb-f6d74966738b service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:57.268559 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5cd04f3f-0981-4f82-aec7-9fc612271ee5 req-67fc5604-26c2-4c9c-92fb-f6d74966738b service nova] Lock "54835fc7-b0b9-4113-90ad-797bdac45590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:57.268559 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5cd04f3f-0981-4f82-aec7-9fc612271ee5 req-67fc5604-26c2-4c9c-92fb-f6d74966738b service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] No waiting events found dispatching network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:57.268677 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5cd04f3f-0981-4f82-aec7-9fc612271ee5 req-67fc5604-26c2-4c9c-92fb-f6d74966738b service nova] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Received event network-vif-unplugged-e5319a59-cd4b-4855-be1e-9107dd976810 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:49:57.548358 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Took 1.46 seconds to deallocate network for instance. Jun 09 11:49:57.651451 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "676d317f-4ade-43c5-b987-b034c703757e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:57.651744 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:58.055838 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:58.056811 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:58.154703 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:49:58.309919 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:58.312009 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:58.341739 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:58.518420 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:58.527792 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:49:58.659086 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999622461999934 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:49:58.664361 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance destroyed successfully. Jun 09 11:49:58.664886 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'numa_topology' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:58.746589 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:58.847774 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:49:58.848014 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:49:59.172860 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Attempting rescue Jun 09 11:49:59.173404 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 09 11:49:59.177760 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:49:59.177760 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Creating image(s) Jun 09 11:49:59.178090 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:59.179008 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:59.179008 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:59.179008 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:59.352034 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:49:59.465789 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-vif-unplugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:59.466086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:59.466289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:59.466442 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:59.466587 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] No waiting events found dispatching network-vif-unplugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:59.466728 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received unexpected event network-vif-unplugged-b0c3f8af-0e22-4133-a923-1b17070d3178 for instance with vm_state active and task_state rescuing. Jun 09 11:49:59.466869 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-vif-unplugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:49:59.467076 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:59.467359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:59.467359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:59.467445 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] No waiting events found dispatching network-vif-unplugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:49:59.467569 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-e2361932-4666-4104-a1a9-094e7995815e req-bff10193-150c-4dd9-b831-18d3ab5b4474 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received unexpected event network-vif-unplugged-b0c3f8af-0e22-4133-a923-1b17070d3178 for instance with vm_state active and task_state rescuing. Jun 09 11:49:59.683510 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:49:59.684280 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:59.689140 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:59.691366 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:49:59.691766 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:59.692082 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:59.696092 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:49:59.696477 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:59.788833 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.092s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:59.789299 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:49:59.832504 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue" returned: 0 in 0.043s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:49:59.833087 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.141s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:59.833508 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'migration_context' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:49:59.859444 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.803s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:49:59.861944 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.116s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:49:59.866281 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:49:59.866498 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Claim successful on node np0000002435 Jun 09 11:49:59.944385 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Deleted allocations for instance 54835fc7-b0b9-4113-90ad-797bdac45590 Jun 09 11:50:00.090854 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000b9a50607 for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:50:00.091376 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.061s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:00.091639 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (8061ms) {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:00.091825 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:50:00.305785 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00052336099997774 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:00.306947 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:00.307069 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:00.307236 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.7598926840000786 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:00.308967 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.7597527220000302 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:00.308967 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] VM Stopped (Lifecycle Event) Jun 09 11:50:00.337817 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:00.338246 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:50:00.338980 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Start _get_guest_xml network_info=[{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:eb:ca:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue={'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:00.339188 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'resources' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:00.366715 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.569547 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.597321 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=17,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:45Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-je49h29z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=b6f3bff5-5831-44df-8fb2-55bb82329aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:00.597544 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:00.598275 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] End _get_guest_xml xml= Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: b6f3bff5-5831-44df-8fb2-55bb82329aab Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: instance-00000011 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 262144 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: multiattach-server-0 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 2026-06-09 11:49:51 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 256 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: True Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: bare Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: ide Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: pc Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: b6f3bff5-5831-44df-8fb2-55bb82329aab Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: b6f3bff5-5831-44df-8fb2-55bb82329aab Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: Jun 09 11:50:00.601088 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:00.603256 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='multiattach-server-0',id=17,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=,launch_index=0,launched_at=2026-06-09T11:48:45Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-je49h29z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=b6f3bff5-5831-44df-8fb2-55bb82329aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:00.603256 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:7d:9f:81"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:00.604352 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:00.605085 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:00.605880 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.605880 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:00.606115 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:00.607636 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.607919 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ee072c-1f4e-55ed-b745-945f361e7f3f', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:00.609290 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.610051 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:00.615570 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.620779 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.621184 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7556c29-41, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:00.621560 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7556c29-41, col_values=(('qos', UUID('8b116c60-8171-4d64-b92b-aef2f75dd824')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:00.621789 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7556c29-41, col_values=(('external_ids', {'iface-id': 'e7556c29-4189-4614-a64c-3b34768b7ad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:9f:81', 'vm-uuid': 'b6f3bff5-5831-44df-8fb2-55bb82329aab'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:00.624359 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.628295 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:00.634924 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:00.635519 np0000002435 nova-compute[98325]: INFO os_vif [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:9f:81,bridge_name='br-int',has_traffic_filtering=True,id=e7556c29-4189-4614-a64c-3b34768b7ad8,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556c29-41') Jun 09 11:50:00.762906 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:00.763179 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:00.810808 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:00.812205 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:00.841235 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:00.843505 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:00.846251 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-717859707', uuid='15ac82d8-f625-48e9-9dee-26835f0cc136'), owner=OwnerMeta(userid='f77769f25d754bdb997c3cdf5b5e46e4', username='tempest-ServerRescueNegativeTestJSON-1703040470-project-member', projectid='8357a877b64741ce827b8108c288a358', projectname='tempest-ServerRescueNegativeTestJSON-1703040470'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:eb:ca:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005800.8444445) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:00.846251 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:00.846251 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:00.847622 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:00.847622 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:00.849285 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:00.849285 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:00.849285 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:00.849285 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:00.849285 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:00.849608 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:00.849608 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:00.850487 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:00.850487 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:00.850487 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:00.850487 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:00.852344 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:00.852344 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:00.957966 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-b774d491-8139-4739-9fcb-6120e8c60d5f tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Lock "54835fc7-b0b9-4113-90ad-797bdac45590" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.789s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:01.265771 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:50:01.314515 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a8610fc5-6d67-4a5f-b7d8-3e531fd90939 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 09 11:50:01.354274 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:01.367167 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717859707',display_name='tempest-ServerRescueNegativeTestJSON-server-717859707',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-717859707',id=22,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:49:52Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-50m5rowm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:52Z,user_data=None,user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=15ac82d8-f625-48e9-9dee-26835f0cc136,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:eb:ca:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:01.367852 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "b0c3f8af-0e22-4133-a923-1b17070d3178", "address": "fa:16:3e:eb:ca:96", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:eb:ca:96"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0c3f8af-0e", "ovs_interfaceid": "b0c3f8af-0e22-4133-a923-1b17070d3178", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:01.367852 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:ca:96,bridge_name='br-int',has_traffic_filtering=True,id=b0c3f8af-0e22-4133-a923-1b17070d3178,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0c3f8af-0e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:01.368394 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:01.662315 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:01.663078 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:01.839779 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:01.873016 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] End _get_guest_xml xml= Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 15ac82d8-f625-48e9-9dee-26835f0cc136 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: instance-00000016 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-server-717859707 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 2026-06-09 11:50:00 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: True Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: bare Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: ide Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: pc Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470-project-member Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 15ac82d8-f625-48e9-9dee-26835f0cc136 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 15ac82d8-f625-48e9-9dee-26835f0cc136 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: Jun 09 11:50:01.874777 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:01.881833 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Instance destroyed successfully. Jun 09 11:50:02.068011 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00042376500005048 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:02.068011 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:02.068011 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.968736000000035 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:02.068011 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.968624039999895 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:02.070858 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:02.071415 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] VM Stopped (Lifecycle Event) Jun 09 11:50:02.154973 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:02.155143 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:02.155253 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:02.155418 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:7d:9f:81, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:02.156280 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Using config drive Jun 09 11:50:02.168121 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:02.574171 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: c2f05fbe-de86-4378-8aa5-c047f02ac7b9] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:02.612370 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:02.646446 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:02.648239 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:02.677198 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.815s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:02.679116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.838s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:02.680047 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:50:02.684768 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:50:02.684913 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Claim successful on node np0000002435 Jun 09 11:50:02.765545 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:02.806997 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:02.813654 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:03.193865 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:50:03.196403 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:50:03.196403 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:03.196403 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:03.202005 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dced51cf-21bc-4ba2-9287-94fe9aeb084d req-0773cb44-adff-4cd7-9067-0ed5173684aa service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:03.202172 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dced51cf-21bc-4ba2-9287-94fe9aeb084d req-0773cb44-adff-4cd7-9067-0ed5173684aa service nova] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:03.205493 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dced51cf-21bc-4ba2-9287-94fe9aeb084d req-0773cb44-adff-4cd7-9067-0ed5173684aa service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:03.205707 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dced51cf-21bc-4ba2-9287-94fe9aeb084d req-0773cb44-adff-4cd7-9067-0ed5173684aa service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:03.205884 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dced51cf-21bc-4ba2-9287-94fe9aeb084d req-0773cb44-adff-4cd7-9067-0ed5173684aa service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] No waiting events found dispatching network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:03.206064 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-dced51cf-21bc-4ba2-9287-94fe9aeb084d req-0773cb44-adff-4cd7-9067-0ed5173684aa service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received unexpected event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 for instance with vm_state active and task_state resize_finish. Jun 09 11:50:03.327114 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7894ab54053542409c89a45f802f240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6543db16cc094a4b81ee1ea4c5957c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:50:03.408776 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:03.408943 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:03.409060 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:03.409196 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:eb:ca:96, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:03.409768 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Using config drive Jun 09 11:50:03.650116 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:03.650672 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] VM Resumed (Lifecycle Event) Jun 09 11:50:03.652984 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance event wait completed in 0 seconds for {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:03.660058 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Instance running successfully. Jun 09 11:50:03.661951 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Failed to set time: agent not configured {{(pid=98325) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 09 11:50:03.663837 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-682e1af1-8cf5-45a4-abcf-12314c0f86b4 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] finish_migration finished successfully. {{(pid=98325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12908}} Jun 09 11:50:03.700306 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:50:03.887006 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:03.916225 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'ec2_ids' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:04.018619 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Successfully created port: 93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:04.155220 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:04.160701 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:04.205332 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:50:04.420163 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:04.420548 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'keypairs' on Instance uuid 15ac82d8-f625-48e9-9dee-26835f0cc136 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:04.468038 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:04.468980 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:04.666976 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 09 11:50:04.666976 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:04.667474 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] VM Started (Lifecycle Event) Jun 09 11:50:04.815449 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Successfully updated port: 93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:04.886369 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Received event network-changed-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:04.889889 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Refreshing instance network info cache due to event network-changed-93459469-6e54-4aaf-af83-083e5a1167fc. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:04.890284 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] Acquiring lock "refresh_cache-676d317f-4ade-43c5-b987-b034c703757e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:04.890481 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] Acquired lock "refresh_cache-676d317f-4ade-43c5-b987-b034c703757e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:04.890934 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Refreshing network info cache for port 93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:04.923342 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<15ac82d8-f625-48e9-9dee-26835f0cc136> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:04.926083 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:04.971382 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:05.103497 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Creating config drive at /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.config.rescue Jun 09 11:50:05.107209 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv24n7tpy {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:05.175304 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:05.175673 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv24n7tpy" returned: 0 in 0.068s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:05.178491 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:05.220986 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:50:05.222289 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:50:05.222656 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Creating image(s) Jun 09 11:50:05.223138 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "/opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:05.223969 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "/opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:05.224564 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "/opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:05.225155 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:05.227982 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:05.229350 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:05.318804 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:05.319098 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:05.319361 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Going to confirm migration 2 {{(pid=98325) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 09 11:50:05.322094 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "refresh_cache-676d317f-4ade-43c5-b987-b034c703757e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:05.327649 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9b3d1ac7-ae2f-4d77-9f77-733ff6c682dc req-dbc8f82c-5c41-4006-a17d-1fd6b2849bef service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:05.328482 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9b3d1ac7-ae2f-4d77-9f77-733ff6c682dc req-dbc8f82c-5c41-4006-a17d-1fd6b2849bef service nova] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:05.328555 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9b3d1ac7-ae2f-4d77-9f77-733ff6c682dc req-dbc8f82c-5c41-4006-a17d-1fd6b2849bef service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:05.328832 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9b3d1ac7-ae2f-4d77-9f77-733ff6c682dc req-dbc8f82c-5c41-4006-a17d-1fd6b2849bef service nova] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:05.328996 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9b3d1ac7-ae2f-4d77-9f77-733ff6c682dc req-dbc8f82c-5c41-4006-a17d-1fd6b2849bef service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] No waiting events found dispatching network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:05.329183 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9b3d1ac7-ae2f-4d77-9f77-733ff6c682dc req-dbc8f82c-5c41-4006-a17d-1fd6b2849bef service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received unexpected event network-vif-plugged-e7556c29-4189-4614-a64c-3b34768b7ad8 for instance with vm_state resized and task_state None. Jun 09 11:50:05.329978 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.100s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:05.330550 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:05.331110 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:05.331730 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:05.335909 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:05.337093 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:05.372719 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:05.394425 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:05.443830 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.103s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:05.443830 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:05.494621 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.816s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:05.495588 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:50:05.524153 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk 1073741824" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:05.524737 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.193s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:05.524843 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:05.571548 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:05.624105 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:05.631215 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.106s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:05.632593 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:50:05.634160 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:05.759131 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:05.759674 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Cannot resize image /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:50:05.760295 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:50:05.760295 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Ensure instance console log exists: /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:05.760506 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:05.760770 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:05.760849 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:05.775471 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:05.776567 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:05.813084 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:05.829349 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:05.907474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:05.999424 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:06.008393 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:50:06.008575 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:50:06.008817 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:06.009069 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:06.010811 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:06.041291 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:06.041291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:06.041291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:06.041291 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:06.041818 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'info_cache' on Instance uuid b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:06.275703 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e12766d5909543f6a81aa3b99c467d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28334e5ba844783948826494406371f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:50:06.279556 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-7d005049-f7bc-4180-b518-272a48808db2 req-5bde1938-05f2-4252-ae10-b5e0ac6f37db service nova] Releasing lock "refresh_cache-676d317f-4ade-43c5-b987-b034c703757e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:06.282511 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquired lock "refresh_cache-676d317f-4ade-43c5-b987-b034c703757e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:06.282511 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:06.520664 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:50:06.779600 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for 15ac82d8-f625-48e9-9dee-26835f0cc136 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:50:06.779984 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:06.779984 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] VM Resumed (Lifecycle Event) Jun 09 11:50:06.789241 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-5375c3d8-7e56-471f-9b32-292cb2d8370d tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:06.935887 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully created port: db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:06.973298 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:07.051780 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:07.092169 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:07.092437 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:07.093149 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:07.093597 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:07.093800 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] No waiting events found dispatching network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:07.094078 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received unexpected event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 for instance with vm_state rescued and task_state None. Jun 09 11:50:07.094991 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:07.094991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] Acquiring lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:07.094991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:07.094991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] Lock "15ac82d8-f625-48e9-9dee-26835f0cc136-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:07.094991 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] No waiting events found dispatching network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:07.095553 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-fa3a95af-1098-4d08-85d2-ee8836c92555 req-5cc3d201-b617-4046-9a60-cb487659eb64 service nova] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Received unexpected event network-vif-plugged-b0c3f8af-0e22-4133-a923-1b17070d3178 for instance with vm_state rescued and task_state None. Jun 09 11:50:07.289988 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:07.294295 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:07.301919 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:07.709089 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully created port: dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:07.764212 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Updating instance_info_cache with network_info: [{"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:07.796756 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:07.796756 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] VM Started (Lifecycle Event) Jun 09 11:50:08.036161 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:50:08.062304 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:08.265753 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Releasing lock "refresh_cache-676d317f-4ade-43c5-b987-b034c703757e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:08.267968 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Instance network_info: |[{"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:50:08.270375 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Start _get_guest_xml network_info=[{"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:08.279837 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:08.281242 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1232948299', uuid='676d317f-4ade-43c5-b987-b034c703757e'), owner=OwnerMeta(userid='7894ab54053542409c89a45f802f240b', username='tempest-VolumesAdminNegativeTest-144355507-project-member', projectid='6543db16cc094a4b81ee1ea4c5957c92', projectname='tempest-VolumesAdminNegativeTest-144355507'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005808.280746) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:08.285560 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:08.286102 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:08.288454 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:08.288787 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:08.290022 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:08.290511 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:08.290749 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:08.290899 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:08.292331 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:08.292331 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:08.292331 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:08.292331 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:08.292772 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:08.292993 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:08.293769 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:08.293987 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:08.309121 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:08.313783 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1232948299',display_name='tempest-VolumesAdminNegativeTest-server-1232948299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesadminnegativetest-server-1232948299',id=23,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6543db16cc094a4b81ee1ea4c5957c92',ramdisk_id='',reservation_id='r-ymw7zy6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-144355507',owner_user_name='tempest-VolumesAdminNegativeTest-144355507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:04Z,user_data=None,user_id='7894ab54053542409c89a45f802f240b',uuid=676d317f-4ade-43c5-b987-b034c703757e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:08.313960 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Converting VIF {"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:08.315058 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:08.316135 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lazy-loading 'pci_devices' on Instance uuid 676d317f-4ade-43c5-b987-b034c703757e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:08.320397 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 15ac82d8-f625-48e9-9dee-26835f0cc136] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:08.402485 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully created port: 6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:08.498703 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.543988 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Booting with volume dc00fe60-f81d-4db8-b0ff-48fe626f166a at /dev/vda Jun 09 11:50:08.617885 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:08.635946 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:50:08.663135 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:08.710980 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:08.719203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:50:08.720099 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:50:08.737118 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:50:08.738342 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96'] Jun 09 11:50:08.738342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:50:08.738342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:50:08.738540 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:08.738821 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating existing volume attachment record: a90efd69-3ee8-4fbb-81ce-96071f175f45 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] End _get_guest_xml xml= Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 676d317f-4ade-43c5-b987-b034c703757e Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: instance-00000017 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: tempest-VolumesAdminNegativeTest-server-1232948299 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 2026-06-09 11:50:08 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: True Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: bare Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: tempest-VolumesAdminNegativeTest-144355507-project-member Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: tempest-VolumesAdminNegativeTest-144355507 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 676d317f-4ade-43c5-b987-b034c703757e Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 676d317f-4ade-43c5-b987-b034c703757e Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: Jun 09 11:50:08.827352 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:08.831203 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Preparing to wait for external event network-vif-plugged-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:08.831203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "676d317f-4ade-43c5-b987-b034c703757e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:08.831203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:08.831203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:08.831203 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1232948299',display_name='tempest-VolumesAdminNegativeTest-server-1232948299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesadminnegativetest-server-1232948299',id=23,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6543db16cc094a4b81ee1ea4c5957c92',ramdisk_id='',reservation_id='r-ymw7zy6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-144355507',owner_user_name='tempest-VolumesAdminNegativeTest-144355507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:04Z,user_data=None,user_id='7894ab54053542409c89a45f802f240b',uuid=676d317f-4ade-43c5-b987-b034c703757e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:08.831472 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Converting VIF {"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:08.834383 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:08.837161 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:08.837161 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.837161 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:08.837161 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:08.837657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.837657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '101b2811-959e-540b-a976-13a9045a56e9', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:08.840303 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.841511 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:08.845891 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.846128 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93459469-6e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:08.846731 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93459469-6e, col_values=(('qos', UUID('b51fe303-1c0f-4448-b3d5-81de23fdab09')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:08.846864 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93459469-6e, col_values=(('external_ids', {'iface-id': '93459469-6e54-4aaf-af83-083e5a1167fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:0e:cc', 'vm-uuid': '676d317f-4ade-43c5-b987-b034c703757e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:08.851207 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.853035 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:08.859927 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:08.860454 np0000002435 nova-compute[98325]: INFO os_vif [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') Jun 09 11:50:09.131994 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully created port: 972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:09.219021 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:09.219176 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'migration_context' on Instance uuid b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:09.728092 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:09.738348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:09.739286 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:10.038587 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005953649999810295 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:10.038587 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:10.038587 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:10.038587 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.6203413420000743 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:10.038587 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] VM Stopped (Lifecycle Event) Jun 09 11:50:10.040891 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=3.617875756999865 future=) was cancelled while queued, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:10.041329 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:10.370407 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:10.384184 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Booting with volume cccb28ff-e435-4216-b524-2a6ba0a79bdc at /dev/vdb Jun 09 11:50:10.390515 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:10.391217 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:10.392096 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] No VIF found with MAC fa:16:3e:6b:0e:cc, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:10.392526 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Using config drive Jun 09 11:50:10.406425 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully created port: 9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:10.524210 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:10.545499 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 54835fc7-b0b9-4113-90ad-797bdac45590] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:10.552297 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:50:10.587683 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:10.651369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:50:10.653258 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:50:10.670430 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:50:10.673167 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96'] Jun 09 11:50:10.674591 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:50:10.674861 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:50:10.675098 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:10.675432 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating existing volume attachment record: 718f472a-93e8-454a-b22c-c99dbd78df8b {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:50:10.921155 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:11.258173 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Rescuing Jun 09 11:50:11.258641 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:11.258856 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:11.259064 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:11.355416 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:11.355880 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:11.370001 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:11.615952 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Creating config drive at /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk.config Jun 09 11:50:11.620399 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa2uw8_3a {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:11.704278 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa2uw8_3a" returned: 0 in 0.083s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:11.764805 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:11.860683 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:11.981709 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:12.037832 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:12.037832 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-db5b2c30-999a-4205-a9e3-0e05c15b24f3. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:12.037832 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:12.037832 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:12.037832 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:12.249455 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:12.312072 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:12.353705 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:12.356707 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:12.386224 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Booting with volume 7e5233d9-a5c9-4a9f-844c-c459559cd348 at /dev/vdc Jun 09 11:50:12.490295 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:12.510911 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:12.529484 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:50:12.545301 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:12.584630 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:12.618609 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Updating instance_info_cache with network_info: [{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:12.636220 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:50:12.636220 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:50:12.654149 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:50:12.655853 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe6b:ecc', 'fe80::40cc:2eff:fef5:bfe2'] Jun 09 11:50:12.656178 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:50:12.656178 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:50:12.657814 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:12.657814 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating existing volume attachment record: 0f0f7032-de76-46dc-9221-fd65430caeb1 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:50:12.736223 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:12.888999 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:12.895164 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.156s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:12.905856 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:12.931614 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:13.062953 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e0d4c982-23f0-4cc4-a015-27e4c3a1626f req-ead3e21f-5d2c-42ca-a734-113e16bd6916 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Received event network-vif-plugged-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:13.063859 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e0d4c982-23f0-4cc4-a015-27e4c3a1626f req-ead3e21f-5d2c-42ca-a734-113e16bd6916 service nova] Acquiring lock "676d317f-4ade-43c5-b987-b034c703757e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:13.063859 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e0d4c982-23f0-4cc4-a015-27e4c3a1626f req-ead3e21f-5d2c-42ca-a734-113e16bd6916 service nova] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:13.063859 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e0d4c982-23f0-4cc4-a015-27e4c3a1626f req-ead3e21f-5d2c-42ca-a734-113e16bd6916 service nova] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:13.063859 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e0d4c982-23f0-4cc4-a015-27e4c3a1626f req-ead3e21f-5d2c-42ca-a734-113e16bd6916 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Processing event network-vif-plugged-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:13.140878 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:13.332660 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:13.617706 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Deleted allocation for migration d28b3f9b-49d8-4f2f-bb91-e2ee7950b628 Jun 09 11:50:13.811233 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:13.811452 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] VM Started (Lifecycle Event) Jun 09 11:50:13.816692 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:13.821280 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:50:13.824942 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Instance spawned successfully. Jun 09 11:50:13.826544 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:50:13.836334 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-26307740-54f1-445c-af0d-e1a40bb2b08b req-9424bc9d-6531-4b66-bd23-4eb92b59c692 service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:13.854429 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:13.867934 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: 41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:14.125678 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-68ff40e1-c604-48a9-a9b4-233b783f0e8d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 8.806s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:14.322271 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:14.328327 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:14.341181 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:14.341704 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:14.342340 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:14.342340 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:14.342768 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:14.343005 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:14.819476 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:14.819476 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:14.829681 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:14.830134 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:14.830134 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] VM Paused (Lifecycle Event) Jun 09 11:50:14.849663 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Took 9.63 seconds to spawn the instance on the hypervisor. Jun 09 11:50:14.849663 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:14.852296 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:14.872947 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:50:14.877483 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:50:14.878689 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Creating image(s) Jun 09 11:50:14.880392 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:50:14.880663 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Ensure instance console log exists: /opt/stack/data/nova/instances/27d39b84-6464-471d-a472-d459193cba46/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:14.881081 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:14.881375 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:14.881542 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:15.050443 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:15.057654 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:15.173437 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance destroyed successfully. Jun 09 11:50:15.173437 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:15.192984 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Received event network-vif-plugged-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:15.194759 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] Acquiring lock "676d317f-4ade-43c5-b987-b034c703757e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:15.194759 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:15.194759 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:15.194759 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] No waiting events found dispatching network-vif-plugged-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:15.194759 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Received unexpected event network-vif-plugged-93459469-6e54-4aaf-af83-083e5a1167fc for instance with vm_state active and task_state None. Jun 09 11:50:15.194979 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:15.195012 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:15.195604 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:15.195604 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:15.195604 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port 41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:15.238674 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a1070be9-e5f2-468a-b628-2592d393e6ec req-4efe7ad1-3280-4ca7-9446-1f0920f14a4c service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:15.238908 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a1070be9-e5f2-468a-b628-2592d393e6ec req-4efe7ad1-3280-4ca7-9446-1f0920f14a4c service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:15.239112 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a1070be9-e5f2-468a-b628-2592d393e6ec req-4efe7ad1-3280-4ca7-9446-1f0920f14a4c service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:15.239292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a1070be9-e5f2-468a-b628-2592d393e6ec req-4efe7ad1-3280-4ca7-9446-1f0920f14a4c service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:15.239414 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a1070be9-e5f2-468a-b628-2592d393e6ec req-4efe7ad1-3280-4ca7-9446-1f0920f14a4c service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:15.239555 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-a1070be9-e5f2-468a-b628-2592d393e6ec req-4efe7ad1-3280-4ca7-9446-1f0920f14a4c service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state active and task_state rescuing. Jun 09 11:50:15.266614 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: 5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:15.334134 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:15.339515 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:15.339662 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] VM Resumed (Lifecycle Event) Jun 09 11:50:15.350110 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:15.350110 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-5f0f3fbb-f84a-4eaa-9560-e874bfac6980. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:15.350110 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:15.372859 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:15.387405 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Took 16.72 seconds to build instance. Jun 09 11:50:15.679545 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Attempting rescue Jun 09 11:50:15.680048 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 09 11:50:15.687257 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:50:15.687440 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Creating image(s) Jun 09 11:50:15.688091 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:15.688351 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:15.688844 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:15.689106 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:15.700692 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:15.786653 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:15.799603 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:15.799880 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:15.846925 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:15.849899 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:15.889291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a4789079-5da3-474b-87f7-c2a03e67a216 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.237s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:15.972049 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:16.193278 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:16.196086 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:16.198856 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:16.201721 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:16.201721 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:16.201721 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:16.206290 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:16.207162 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:16.321804 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.114s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:16.322437 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.rescue {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:16.355325 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.998829002999855 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:16.356082 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998160939999934 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:16.356082 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997956726999973 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:16.387498 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.rescue" returned: 0 in 0.065s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:16.390960 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.189s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:16.391389 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'migration_context' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:16.474899 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2acb31a7-51cf-4dbf-8866-2abf3c4380de req-331bfb61-ee80-48a4-a385-300d7d00d7f9 service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:16.475795 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:16.476396 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port 5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:16.606869 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:16.617854 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:16.798752 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:16.798951 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:50:16.800219 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:16.895997 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:16.896830 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:50:16.898833 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Start _get_guest_xml network_info=[{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:77:4e:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue={'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:16.898833 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'resources' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:16.980654 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:17.107316 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:17.307639 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:17.307739 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing instance network info cache due to event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:17.308025 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:17.308121 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:17.308295 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:17.364924 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c6b77d1-ec94-4fd4-92ad-6bca366e239f req-b5764e90-4eb5-4876-8c04-cba386e69b28 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:17.365391 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c6b77d1-ec94-4fd4-92ad-6bca366e239f req-b5764e90-4eb5-4876-8c04-cba386e69b28 service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:17.365537 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c6b77d1-ec94-4fd4-92ad-6bca366e239f req-b5764e90-4eb5-4876-8c04-cba386e69b28 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:17.365696 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c6b77d1-ec94-4fd4-92ad-6bca366e239f req-b5764e90-4eb5-4876-8c04-cba386e69b28 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:17.365872 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c6b77d1-ec94-4fd4-92ad-6bca366e239f req-b5764e90-4eb5-4876-8c04-cba386e69b28 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:17.366051 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-0c6b77d1-ec94-4fd4-92ad-6bca366e239f req-b5764e90-4eb5-4876-8c04-cba386e69b28 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state active and task_state rescuing. Jun 09 11:50:17.380041 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:17.402462 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:17.411347 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:17.418718 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-347303546', uuid='5e03b1ab-e8ab-4fbe-8171-33617997b734'), owner=OwnerMeta(userid='f77769f25d754bdb997c3cdf5b5e46e4', username='tempest-ServerRescueNegativeTestJSON-1703040470-project-member', projectid='8357a877b64741ce827b8108c288a358', projectname='tempest-ServerRescueNegativeTestJSON-1703040470'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:77:4e:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005817.418107) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:17.421855 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:17.422994 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:17.426369 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:17.426776 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:17.427917 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:17.428443 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:17.429256 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:17.430642 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:17.432014 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:17.432195 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:17.433249 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:17.450628 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:17.450628 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-dd09698b-8819-4223-ba54-5997b963a450. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:17.450628 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:17.794778 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:17.796468 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:17.799135 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:17.799706 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:17.811003 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:17.882741 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6291b72b-757b-47c2-90f8-3c88d532cd34 req-0d647fba-91e5-4059-8939-74955fc892c8 service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:17.882888 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:17.883436 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:17.925700 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: 6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:17.937892 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:17.956292 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-347303546',display_name='tempest-ServerRescueNegativeTestJSON-server-347303546',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-347303546',id=21,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:49:53Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-1cder433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:49:54Z,user_data=None,user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=5e03b1ab-e8ab-4fbe-8171-33617997b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:77:4e:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:17.956292 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:77:4e:7a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:17.956292 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:4e:7a,bridge_name='br-int',has_traffic_filtering=True,id=c70b4955-6289-438a-b45b-85c8c2c612b6,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc70b4955-62') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:17.958183 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:18.277512 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:18.388585 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:18.462238 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] End _get_guest_xml xml= Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 5e03b1ab-e8ab-4fbe-8171-33617997b734 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: instance-00000015 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-server-347303546 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 2026-06-09 11:50:17 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: True Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: bare Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: ide Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: pc Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470-project-member Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 5e03b1ab-e8ab-4fbe-8171-33617997b734 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 5e03b1ab-e8ab-4fbe-8171-33617997b734 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: Jun 09 11:50:18.463615 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:18.476487 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance destroyed successfully. Jun 09 11:50:18.566788 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:18.650889 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updated VIF entry in instance network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:50:18.651797 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:18.794605 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:18.795462 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:18.801108 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:18.801108 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:18.836976 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:18.863499 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:19.153972 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:19.156227 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:19.156227 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing instance network info cache due to event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:19.156227 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:19.156227 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:19.156227 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:19.306959 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:19.308516 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:19.308516 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:19.308516 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:50:19.345630 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-46d2b0cf-d204-43c5-97d7-a579fd6ddf56 req-f8442b47-6031-4bc2-b537-e8d660f54ffe service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:19.359951 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: 972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:19.399230 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:19.399230 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-6cb0c616-4a6d-43a3-be75-4a37d5e762ee. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:19.399230 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:19.399230 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:19.399941 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port 6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:19.657731 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:19.906211 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:20.015137 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:20.015137 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:20.015137 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:20.015454 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:77:4e:7a, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:20.015877 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Using config drive Jun 09 11:50:20.071657 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:20.305061 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:20.375138 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:20.385443 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:20.448414 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "676d317f-4ade-43c5-b987-b034c703757e" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:20.448966 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:20.449243 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "676d317f-4ade-43c5-b987-b034c703757e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:20.449479 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:20.449656 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:20.454701 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Terminating instance Jun 09 11:50:20.483774 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:20.484226 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:20.524078 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:20.589341 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:20.592955 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.rescue --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:20.710395 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.rescue --force-share --output=json" returned: 0 in 0.117s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:20.711373 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.rescue --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:20.850742 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:20.866654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:20.866654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:20.903009 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:20.964115 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:50:20.984138 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:20.984138 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.013639 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.040175 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:21.040175 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'keypairs' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:21.047551 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.058874 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.099346 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.110923 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.113311 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000015, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config.rescue' Jun 09 11:50:21.127834 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.241870 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.242507 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.302515 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updated VIF entry in instance network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:50:21.304229 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:21.334406 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999546368999972 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:21.342931 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Instance destroyed successfully. Jun 09 11:50:21.343612 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lazy-loading 'resources' on Instance uuid 676d317f-4ade-43c5-b987-b034c703757e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:21.389639 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.394704 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.414175 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4918d4f9-8fe9-474a-9201-bdc90a611b51 req-e04abf02-e540-4d26-8556-cda59797129b service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:21.530966 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:21.531492 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-972fd9d4-c41e-4586-a696-46db1e2103d1. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:21.531492 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:21.531662 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:21.533008 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port 972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:21.534852 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.535610 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.552190 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:21.569943 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:21.671611 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.673735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.774543 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Creating config drive at /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config.rescue Jun 09 11:50:21.789963 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpif33p8u0 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.802458 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.805782 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:21.825475 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f8077e3c-01f0-4947-abdb-644b7c126d3a req-a1df69b6-c6d5-4bf0-82ed-c4e12cd1f5fb service nova] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:21.851106 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1232948299',display_name='tempest-VolumesAdminNegativeTest-server-1232948299',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumesadminnegativetest-server-1232948299',id=23,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:50:14Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6543db16cc094a4b81ee1ea4c5957c92',ramdisk_id='',reservation_id='r-ymw7zy6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-144355507',owner_user_name='tempest-VolumesAdminNegativeTest-144355507-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:15Z,user_data=None,user_id='7894ab54053542409c89a45f802f240b',uuid=676d317f-4ade-43c5-b987-b034c703757e,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:50:21.852064 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Converting VIF {"id": "93459469-6e54-4aaf-af83-083e5a1167fc", "address": "fa:16:3e:6b:0e:cc", "network": {"id": "3127302a-c2d0-47cd-ba65-b73722b003bc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1441489334-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6543db16cc094a4b81ee1ea4c5957c92", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93459469-6e", "ovs_interfaceid": "93459469-6e54-4aaf-af83-083e5a1167fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:21.852359 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:21.853137 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:50:21.854571 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.854964 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93459469-6e, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:21.856685 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpif33p8u0" returned: 0 in 0.067s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.858720 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.859653 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:21.864609 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.866094 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.866560 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b51fe303-1c0f-4448-b3d5-81de23fdab09) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:21.867111 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.868097 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:21.880593 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:21.885815 np0000002435 nova-compute[98325]: INFO os_vif [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:0e:cc,bridge_name='br-int',has_traffic_filtering=True,id=93459469-6e54-4aaf-af83-083e5a1167fc,network=Network(3127302a-c2d0-47cd-ba65-b73722b003bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93459469-6e') Jun 09 11:50:21.886494 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Deleting instance files /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e_del Jun 09 11:50:21.888165 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Deletion of /opt/stack/data/nova/instances/676d317f-4ade-43c5-b987-b034c703757e_del complete Jun 09 11:50:21.915234 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:21.924411 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:50:21.925942 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.030230 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.039089 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.047622 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:22.164231 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.171292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.226367 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:22.283187 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Successfully updated port: 9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:22.289155 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.290706 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.401781 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.411897 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.428705 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Took 1.46 seconds to destroy the instance on the hypervisor. Jun 09 11:50:22.443511 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:50:22.450347 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:50:22.450347 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:50:22.450347 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:22.453878 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:22.456320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:22.490688 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:22.528691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.532288 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.553578 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:22.644163 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:22.649249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.650865 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:50:22.658137 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.681932 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:22.723641 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:22.764137 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.764758 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.792767 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:22.819317 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:22.859617 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.860332 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:50:22.871466 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:22.874745 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:22.932867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:22.933821 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=12070MB free_disk=74.20428848266602GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:50:22.934248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:22.935215 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:22.957780 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:50:23.110502 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-50e90d5b-c8b1-4a8d-9af6-7cb73234ff5a req-4ef6c544-c757-4419-9300-f7e3615ab753 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:23.114003 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-50e90d5b-c8b1-4a8d-9af6-7cb73234ff5a req-4ef6c544-c757-4419-9300-f7e3615ab753 service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:23.114206 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-50e90d5b-c8b1-4a8d-9af6-7cb73234ff5a req-4ef6c544-c757-4419-9300-f7e3615ab753 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:23.114368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-50e90d5b-c8b1-4a8d-9af6-7cb73234ff5a req-4ef6c544-c757-4419-9300-f7e3615ab753 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:23.114519 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-50e90d5b-c8b1-4a8d-9af6-7cb73234ff5a req-4ef6c544-c757-4419-9300-f7e3615ab753 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:23.114665 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-50e90d5b-c8b1-4a8d-9af6-7cb73234ff5a req-4ef6c544-c757-4419-9300-f7e3615ab753 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state active and task_state rescuing. Jun 09 11:50:23.187214 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5eae362e-c77a-41bf-9b62-0b02b1b3c349 req-8873d70d-7527-4cad-9af8-456e284eb224 service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:23.187794 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:23.188031 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:23.495614 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for 5e03b1ab-e8ab-4fbe-8171-33617997b734 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:50:23.499827 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:23.499827 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Resumed (Lifecycle Event) Jun 09 11:50:23.502433 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-165a9653-119a-4aca-b756-0bc1b6a877a9 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:23.537627 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:23.626710 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:23.626957 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:23.627233 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:23.869221 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:23.935590 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:24.001697 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:24.007826 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:24.041689 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.041689 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.041689 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 91b55628-1195-485f-910b-bf2d27fd4bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.041689 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance a2861c32-71b0-4b66-a389-6bb079d7624e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.041689 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance ebcd1754-decd-470c-8d2f-1042b628a12f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.042068 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 5e03b1ab-e8ab-4fbe-8171-33617997b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.042160 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 15ac82d8-f625-48e9-9dee-26835f0cc136 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.042347 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance b6f3bff5-5831-44df-8fb2-55bb82329aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.043155 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 676d317f-4ade-43c5-b987-b034c703757e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.043155 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 27d39b84-6464-471d-a472-d459193cba46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:50:24.245896 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:24.371793 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Took 1.92 seconds to deallocate network for instance. Jun 09 11:50:24.510289 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:24.510289 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Started (Lifecycle Event) Jun 09 11:50:24.551930 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 6bd4cad7-4f07-44d4-be1b-c55da061851d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 09 11:50:24.552636 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:50:24.552636 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:50:22 up 33 min, 2 users, load average: 8.60, 5.30, 2.52\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_9e3020791dcd4ef4b7980dd196a8ca96': '5', 'io_workload': '2', 'num_proj_2e4846fa228b4be9829a4e85eabc18a2': '1', 'num_task_rescuing': '1', 'num_proj_8357a877b64741ce827b8108c288a358': '2', 'num_vm_rescued': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_d28334e5ba844783948826494406371f': '1', 'num_task_deleting': '1', 'num_proj_6543db16cc094a4b81ee1ea4c5957c92': '1'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:50:24.660936 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:24.886807 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:24.982559 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Unrescuing Jun 09 11:50:24.982705 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:24.983316 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:24.983316 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:25.012634 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:25.017176 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:25.087855 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:25.380620 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:25.380796 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:25.388856 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:25.471097 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:25.484955 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:25.520666 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 09 11:50:25.603603 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:25.604647 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:25.718014 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3c86cc78-abd9-4412-850a-41691527d07c req-0836603a-3f1d-4491-a05f-e50a3842d98c service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:25.718014 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3c86cc78-abd9-4412-850a-41691527d07c req-0836603a-3f1d-4491-a05f-e50a3842d98c service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:25.718014 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3c86cc78-abd9-4412-850a-41691527d07c req-0836603a-3f1d-4491-a05f-e50a3842d98c service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:25.718014 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3c86cc78-abd9-4412-850a-41691527d07c req-0836603a-3f1d-4491-a05f-e50a3842d98c service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:25.718014 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3c86cc78-abd9-4412-850a-41691527d07c req-0836603a-3f1d-4491-a05f-e50a3842d98c service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:25.718014 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-3c86cc78-abd9-4412-850a-41691527d07c req-0836603a-3f1d-4491-a05f-e50a3842d98c service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state rescued and task_state unrescuing. Jun 09 11:50:25.884731 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:25.901775 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:25.927146 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:26.106481 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:50:26.180419 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Updating instance_info_cache with network_info: [{"id": "c70b4955-6289-438a-b45b-85c8c2c612b6", "address": "fa:16:3e:77:4e:7a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc70b4955-62", "ovs_interfaceid": "c70b4955-6289-438a-b45b-85c8c2c612b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:26.206993 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:26.353747 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:26.392387 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:50:26.392945 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.458s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:26.393416 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.857s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:26.393808 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:26.396729 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:50:26.396890 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Claim successful on node np0000002435 Jun 09 11:50:26.685439 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-5e03b1ab-e8ab-4fbe-8171-33617997b734" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:26.685439 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'flavor' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:26.720946 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:26.777883 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:26.863666 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:26.868591 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:27.029202 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [{"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:27.216340 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:27.223718 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:27.246042 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:27.395180 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:27.395453 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:50:27.399035 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.40 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:27.431744 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:27.444491 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:27.445308 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:27.448490 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:27.532174 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:27.532882 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance network_info: |[{"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:50:27.535532 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Start _get_guest_xml network_info=[{"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27d39b84-6464-471d-a472-d459193cba46', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'serial': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a'}, 'attachment_id': 'a90efd69-3ee8-4fbb-81ce-96071f175f45', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27d39b84-6464-471d-a472-d459193cba46', 'attached_at': '', 'detached_at': '', 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'serial': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc'}, 'attachment_id': '718f472a-93e8-454a-b22c-c99dbd78df8b', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27d39b84-6464-471d-a472-d459193cba46', 'attached_at': '', 'detached_at': '', 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'serial': '7e5233d9-a5c9-4a9f-844c-c459559cd348'}, 'attachment_id': '0f0f7032-de76-46dc-9221-fd65430caeb1', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:27.536650 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:27.536862 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port 9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:27.546670 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:27.548103 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-143407640', uuid='27d39b84-6464-471d-a472-d459193cba46'), owner=OwnerMeta(userid='e12766d5909543f6a81aa3b99c467d7c', username='tempest-TaggedBootDevicesTest-1697688058-project-member', projectid='d28334e5ba844783948826494406371f', projectname='tempest-TaggedBootDevicesTest-1697688058'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005827.5469668) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:27.558948 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:27.560023 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:27.569106 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:27.569106 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:27.570373 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:27.571205 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:27.571205 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:27.571205 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:27.571538 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:27.571856 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:27.571856 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:27.572138 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:27.572500 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:27.572500 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:27.572679 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:27.572849 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:27.588837 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999457883000105 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:27.592655 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:50:27.595380 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:27.595380 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:27.595380 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:27.595380 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:50:27.599542 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Instance destroyed successfully. Jun 09 11:50:27.599542 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e03b1ab-e8ab-4fbe-8171-33617997b734 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:27.615635 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:27.617581 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:27.618751 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:27.619274 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:27.620282 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:27.620282 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:27.635143 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:27.635143 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:27.638810 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:27.638810 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a] added Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:27.650769 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:27.651221 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:27.651280 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:27.651525 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a] added Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:27.653889 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:27.654132 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:27.654688 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:27.654688 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:27.806745 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9aaa9410-c77b-4740-b4fc-bf9d44967784 req-58e4b3e4-19ab-4318-bcfa-7e9d3731486b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:27.807239 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9aaa9410-c77b-4740-b4fc-bf9d44967784 req-58e4b3e4-19ab-4318-bcfa-7e9d3731486b service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:27.807443 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9aaa9410-c77b-4740-b4fc-bf9d44967784 req-58e4b3e4-19ab-4318-bcfa-7e9d3731486b service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:27.807557 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9aaa9410-c77b-4740-b4fc-bf9d44967784 req-58e4b3e4-19ab-4318-bcfa-7e9d3731486b service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:27.807680 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9aaa9410-c77b-4740-b4fc-bf9d44967784 req-58e4b3e4-19ab-4318-bcfa-7e9d3731486b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:27.807786 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9aaa9410-c77b-4740-b4fc-bf9d44967784 req-58e4b3e4-19ab-4318-bcfa-7e9d3731486b service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state rescued and task_state unrescuing. Jun 09 11:50:27.951152 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:50:28.040647 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:28.101346 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance<5e03b1ab-e8ab-4fbe-8171-33617997b734> lazy-loaded attributes: flavor,numa_topology {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:50:28.241789 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:28.242029 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:28.472464 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:28.474189 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:28.522323 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:28.571533 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:28.605182 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:28.653036 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:28.654972 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:28.679651 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:28.684069 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.698789 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.700854 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.707059 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:28.723171 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.723171 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.723171 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.723171 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.723171 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:28.724165 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.724165 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.724165 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.724165 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.724165 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:28.724566 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.724566 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.724566 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.724566 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.724566 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:28.724849 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.724849 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.724849 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.724849 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.724849 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:28.746287 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:28.773090 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updated VIF entry in instance network info cache for port 9ef25b9f-6e2e-4716-986b-bac1f4bf61ab. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:50:28.773901 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [{"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:28.776042 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.50.100,3260] Jun 09 11:50:28.776042 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.50.100,3260] successful. Jun 09 11:50:28.776042 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.781637 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.40.100,3260] Jun 09 11:50:28.781637 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.40.100,3260] successful. Jun 09 11:50:28.781637 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.787823 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:28.789333 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:28.797925 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.806139 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] HCTL ('9', '-', '-', 0) found on session 33 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:28.817304 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:28.825821 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:28.826612 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] HCTL ('10', '-', '-', 0) found on session 34 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:28.826779 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:28.842118 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 33 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:28.842118 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:28.855808 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 34 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:28.855808 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:29.253955 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.861s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:29.254756 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.368s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:29.255065 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:50:29.278285 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:29.278285 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Received event network-vif-deleted-93459469-6e54-4aaf-af83-083e5a1167fc {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:29.278457 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Neutron deleted interface 93459469-6e54-4aaf-af83-083e5a1167fc; detaching it from the instance and deleting it from the info cache Jun 09 11:50:29.281305 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0d57854a-9dfa-4ebf-bbff-99e0793d0c6b req-3a9ff8d3-59fe-4cf1-9e03-daedf05c2c77 service nova] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Detach interface failed, port_id=93459469-6e54-4aaf-af83-083e5a1167fc, reason: Instance 676d317f-4ade-43c5-b987-b034c703757e could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:50:29.621874 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:50:29.623912 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ce152bcf-cdea-4d6d-9ef7-3ae8b6fc2f20 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:29.624385 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for 5e03b1ab-e8ab-4fbe-8171-33617997b734 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:50:29.624510 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:29.624676 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Resumed (Lifecycle Event) Jun 09 11:50:29.764787 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:50:29.765019 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:50:29.765561 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:29.765896 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:29.883175 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:29.883625 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:29.883820 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:29.883930 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:29.884149 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:29.884333 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-unplugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state active and task_state None. Jun 09 11:50:29.884380 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:29.884504 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:29.884611 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:29.884743 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:29.884876 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:29.884976 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state active and task_state None. Jun 09 11:50:29.885080 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:29.885185 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Acquiring lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:29.885319 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:29.885438 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] Lock "5e03b1ab-e8ab-4fbe-8171-33617997b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:29.885566 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] No waiting events found dispatching network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:29.885663 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-5681cacf-35c1-41f6-ba08-2c34d3a28867 req-44a5702d-8226-45f6-883a-9e0cc1903857 service nova] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Received unexpected event network-vif-plugged-c70b4955-6289-438a-b45b-85c8c2c612b6 for instance with vm_state active and task_state None. Jun 09 11:50:29.928546 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:29.928731 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:29.960002 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddf799345eda47c9a2a8251730b4b53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a1b48558162488ca7f74f39eaea8192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:50:30.129783 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:30.133502 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:30.271767 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:50:30.390574 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:30.596977 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:30.640731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Found WWN 330000000881cc3d4 for multipath device dm-3 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:50:30.640731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:30.640731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000881cc3d4', 'path': '/dev/dm-3', 'multipath_id': '330000000881cc3d4'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:30.640731 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000881cc3d4', 'path': '/dev/dm-3', 'multipath_id': '330000000881cc3d4'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:50:30.642308 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:30.642730 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] VM Started (Lifecycle Event) Jun 09 11:50:30.726027 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Successfully created port: aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:30.776287 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:50:31.107368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.853s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:31.109660 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.387s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:31.112781 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:50:31.112940 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Claim successful on node np0000002435 Jun 09 11:50:31.145246 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:31.148889 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 5e03b1ab-e8ab-4fbe-8171-33617997b734] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:31.150817 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:50:31.152351 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:31.152468 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:31.152896 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:31.154429 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:50:31.172159 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:31.172624 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:31.173512 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:31.174334 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:31.174916 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:31.175097 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:31.186871 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:31.186871 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:31.193787 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:31.193787 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc] added Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:31.203559 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:31.203832 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:31.203832 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:31.203961 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:31.204287 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Deleted allocations for instance 676d317f-4ade-43c5-b987-b034c703757e Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc] added Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:31.207763 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:31.207999 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:31.208082 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:31.208208 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:31.280328 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Booting with volume 742d8f55-5c2e-4a97-a694-267b213b2d5d at /dev/vda Jun 09 11:50:31.301307 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Successfully updated port: aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:31.345112 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:31.354309 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003358559999924182 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:31.354635 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:31.354790 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.979113246999987 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:31.355346 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.978712856000129 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:31.357672 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:50:31.388291 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:31.406637 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-changed-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:31.406905 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Refreshing instance network info cache due to event network-changed-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:31.407356 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] Acquiring lock "refresh_cache-6bd4cad7-4f07-44d4-be1b-c55da061851d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:31.410831 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] Acquired lock "refresh_cache-6bd4cad7-4f07-44d4-be1b-c55da061851d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:31.410831 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Refreshing network info cache for port aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:31.430464 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:50:31.430943 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:50:31.443087 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:50:31.443087 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a'] Jun 09 11:50:31.443087 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:50:31.443087 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:50:31.443087 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:31.443087 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Updating existing volume attachment record: 8e17232f-47d0-4399-abec-069663e8ad24 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:50:31.802937 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "refresh_cache-6bd4cad7-4f07-44d4-be1b-c55da061851d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:31.869984 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:31.913633 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:31.989458 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:32.117435 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:32.204808 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:32.208602 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:32.217511 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-d8cbb68b-11b9-49aa-b3ce-5a4f0e8df540 tempest-VolumesAdminNegativeTest-144355507 tempest-VolumesAdminNegativeTest-144355507-project-member] Lock "676d317f-4ade-43c5-b987-b034c703757e" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 11.769s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:32.225368 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:32.239881 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.251588 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.261682 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.274411 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.278620 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.278878 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:32.313952 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.40.100,3260] Jun 09 11:50:32.313952 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.40.100,3260] successful. Jun 09 11:50:32.313952 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.332464 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.338005 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.50.100,3260] Jun 09 11:50:32.338005 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.50.100,3260] successful. Jun 09 11:50:32.338005 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.351580 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.359108 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.359420 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:32.359710 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:32.360285 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:32.361021 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] HCTL ('11', '-', '-', 0) found on session 35 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:32.361293 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:32.379230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:32.380210 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 35 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:32.380510 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:32.381617 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] HCTL ('12', '-', '-', 0) found on session 36 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:32.381840 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:32.397388 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 36 and hctl ['12', '*', '*', 0] yield: None {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:32.621169 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-48c0d177-ee25-4449-95a5-d874667af637 req-a6e7164e-f248-4b00-a7b9-3093e7382f4f service nova] Releasing lock "refresh_cache-6bd4cad7-4f07-44d4-be1b-c55da061851d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:32.622390 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquired lock "refresh_cache-6bd4cad7-4f07-44d4-be1b-c55da061851d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:32.622390 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:32.925162 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:32.925408 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:33.190056 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:33.336940 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:33.398138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 36 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:33.398469 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:33.428111 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:33.542831 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Updating instance_info_cache with network_info: [{"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:33.614506 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:50:33.616039 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:50:33.616592 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Creating image(s) Jun 09 11:50:33.617150 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:50:33.618287 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Ensure instance console log exists: /opt/stack/data/nova/instances/6bd4cad7-4f07-44d4-be1b-c55da061851d/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:33.618287 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:33.618287 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:33.618287 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:33.936863 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.829s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:33.937610 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:50:33.939687 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.415s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:33.943579 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:50:33.943720 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Claim successful on node np0000002435 Jun 09 11:50:34.047831 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Releasing lock "refresh_cache-6bd4cad7-4f07-44d4-be1b-c55da061851d" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:34.048308 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Instance network_info: |[{"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:50:34.049229 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Start _get_guest_xml network_info=[{"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6bd4cad7-4f07-44d4-be1b-c55da061851d', 'attached_at': '', 'detached_at': '', 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'serial': '742d8f55-5c2e-4a97-a694-267b213b2d5d'}, 'attachment_id': '8e17232f-47d0-4399-abec-069663e8ad24', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:34.051502 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:34.052933 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='6bd4cad7-4f07-44d4-be1b-c55da061851d'), owner=OwnerMeta(userid='ddf799345eda47c9a2a8251730b4b53f', username='tempest-ImageDependencyTests-1916619139-project-member', projectid='4a1b48558162488ca7f74f39eaea8192', projectname='tempest-ImageDependencyTests-1916619139'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005834.0525124) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:34.054021 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:34.054442 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:34.055217 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:34.055775 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:34.056540 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:34.057039 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:34.057278 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:34.057433 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:34.057613 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:34.057744 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:34.057871 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:34.058013 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:34.058195 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:34.058356 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:34.058513 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:34.058686 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:34.079357 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:50:34.079753 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:34.079978 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:34.193726 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Found WWN 3300000009caf747f for multipath device dm-7 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:50:34.194848 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:34.195076 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000009caf747f', 'path': '/dev/dm-7', 'multipath_id': '3300000009caf747f'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:34.195286 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009caf747f', 'path': '/dev/dm-7', 'multipath_id': '3300000009caf747f'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:50:34.196058 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.116s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:34.196614 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:50:34.212780 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:34.214197 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:34.214660 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:34.215773 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:34.215957 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:34.216216 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:34.236047 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:34.236047 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:34.241609 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:34.241609 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d] added Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:34.256976 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:34.257220 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:34.257423 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:34.257631 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d] added Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:34.261743 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:34.262098 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:34.262098 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:34.262208 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:34.444771 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:50:34.445092 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:50:34.445545 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:34.445966 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:34.473379 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:34.604350 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3014eb93944045468f25c84897e09e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4846fa228b4be9829a4e85eabc18a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:50:34.701384 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:50:34.701755 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:34.701940 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:34.869567 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:34.870040 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:34.950288 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:50:35.259313 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:35.263288 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:35.276728 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Successfully created port: 33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:35.284526 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:35.292352 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.304459 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.311843 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.325981 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.326457 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.334608 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.334930 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:35.373088 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:50:35.390908 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.40.100,3260] Jun 09 11:50:35.390908 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.40.100,3260] successful. Jun 09 11:50:35.390908 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.398143 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:35.410022 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.50.100,3260] Jun 09 11:50:35.410022 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.50.100,3260] successful. Jun 09 11:50:35.410022 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.411850 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.430442 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.450597 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:35.452766 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:35.454412 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:35.455845 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:50:35.463077 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] HCTL ('15', '-', '-', 0) found on session 37 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:35.463316 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:35.464015 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] HCTL ('16', '-', '-', 0) found on session 38 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:35.464185 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:35.513483 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Searching for a device in session 38 and hctl ['16', '*', '*', 0] yield: None {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:35.513483 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Searching for a device in session 37 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:35.513483 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:35.847391 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:35.847714 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:35.955537 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:36.116771 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Successfully updated port: 33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:36.201194 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-changed-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:36.201389 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Refreshing instance network info cache due to event network-changed-33bece78-1b53-425f-9be3-0e4229fdb64a. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:36.201632 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] Acquiring lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:36.201775 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] Acquired lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:36.201925 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Refreshing network info cache for port 33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:36.334401 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004360489999726269 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:36.334921 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:36.334921 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.253581398000051 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:36.334921 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=6.2534684160000324 future=) was cancelled while queued, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:36.334921 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:36.335876 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:36.336045 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 676d317f-4ade-43c5-b987-b034c703757e] VM Stopped (Lifecycle Event) Jun 09 11:50:36.350710 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:36.468670 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:50:36.469764 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:50:36.471391 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Creating image(s) Jun 09 11:50:36.472827 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "/opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:36.473240 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "/opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:36.474069 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "/opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:36.475376 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:36.479821 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:36.481684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:36.497504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Searching for a device in session 38 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:36.497504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:36.578873 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:36.579382 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:36.579892 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:36.580427 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:36.584113 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:36.584113 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:36.622876 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:36.675719 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.091s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:36.676182 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:36.706187 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:36.730654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk 1073741824" returned: 0 in 0.054s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:36.731141 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.151s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:36.731547 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:36.812307 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:36.832902 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.101s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:36.833697 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:50:36.834049 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:36.857697 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e4510c64-7c2f-4a77-80a2-8ad68421c226 None None] [instance: 676d317f-4ade-43c5-b987-b034c703757e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:36.865695 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.928s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:36.867920 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:50:36.874358 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.912s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:36.875324 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:36.879372 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:50:36.879890 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Claim successful on node np0000002435 Jun 09 11:50:36.943596 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:36.944219 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Cannot resize image /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:50:36.950535 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:50:36.950535 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Ensure instance console log exists: /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:36.950535 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:36.950535 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:36.950535 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:37.045651 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:37.109235 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:37.234478 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Found WWN 330000000adf53e0d for multipath device dm-8 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:50:37.235345 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:37.235618 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] <== connect_volume: return (3155ms) {'type': 'block', 'scsi_wwn': '330000000adf53e0d', 'path': '/dev/dm-8', 'multipath_id': '330000000adf53e0d'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:37.235822 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000adf53e0d', 'path': '/dev/dm-8', 'multipath_id': '330000000adf53e0d'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:50:37.236595 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.535s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:37.236891 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:50:37.253553 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:37.254538 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:37.256074 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:37.256074 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:37.256828 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:37.257134 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:37.272686 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:37.272686 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:37.278413 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:37.278413 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348] added Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:37.296799 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:37.297017 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:37.297337 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0412(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:37.297557 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348] added Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:37.302501 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:37.302840 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:37.302925 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0459(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:37.303118 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:37.378971 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:50:37.379433 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:50:37.382692 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:37.382692 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:37.472867 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a22b8c3e8e0442dbb1610a6c4711f534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4788b73b12d54f048721db84c2083cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:50:37.547212 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0b50198b-5bb3-4742-8d3e-4fb7b6aeb73b req-fd73473c-e634-47f1-a537-c914d3c2b3e4 service nova] Releasing lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:37.548016 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquired lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:37.548238 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:37.742137 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='instance-depend-image',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a1b48558162488ca7f74f39eaea8192',ramdisk_id='',reservation_id='r-0o4p54ir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1916619139',owner_user_name='tempest-ImageDependencyTests-1916619139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:31Z,user_data=None,user_id='ddf799345eda47c9a2a8251730b4b53f',uuid=6bd4cad7-4f07-44d4-be1b-c55da061851d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:37.742450 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Converting VIF {"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:37.743134 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:37.744525 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bd4cad7-4f07-44d4-be1b-c55da061851d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:37.884898 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:50:38.039211 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Successfully created port: f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:38.077388 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Stashing vm_state: active {{(pid=98325) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 09 11:50:38.144216 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] End _get_guest_xml xml= Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 6bd4cad7-4f07-44d4-be1b-c55da061851d Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: instance-00000019 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: instance-depend-image Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 2026-06-09 11:50:34 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: True Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: tempest-ImageDependencyTests-1916619139-project-member Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: tempest-ImageDependencyTests-1916619139 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 6bd4cad7-4f07-44d4-be1b-c55da061851d Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 6bd4cad7-4f07-44d4-be1b-c55da061851d Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: 742d8f55-5c2e-4a97-a694-267b213b2d5d Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: Jun 09 11:50:38.248420 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:38.250189 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Preparing to wait for external event network-vif-plugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:38.250189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:38.250189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:38.250189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:38.250189 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='instance-depend-image',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a1b48558162488ca7f74f39eaea8192',ramdisk_id='',reservation_id='r-0o4p54ir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1916619139',owner_user_name='tempest-ImageDependencyTests-1916619139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:31Z,user_data=None,user_id='ddf799345eda47c9a2a8251730b4b53f',uuid=6bd4cad7-4f07-44d4-be1b-c55da061851d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:38.250189 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Converting VIF {"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:38.250498 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:38.252351 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:38.252351 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.252351 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:38.252534 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:38.253524 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.253734 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '535090e0-9cb6-50b2-88b7-ec05d689f443', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:38.254512 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.255921 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:38.255921 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.258541 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.258772 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa0b4c0e-51, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:38.259204 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa0b4c0e-51, col_values=(('qos', UUID('b99b48b4-0d22-439b-8632-d9625de28643')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:38.259470 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa0b4c0e-51, col_values=(('external_ids', {'iface-id': 'aa0b4c0e-5129-41cf-bcbf-b5b71cd47043', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:d7:8c', 'vm-uuid': '6bd4cad7-4f07-44d4-be1b-c55da061851d'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:38.260804 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.262465 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:38.268498 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:38.269807 np0000002435 nova-compute[98325]: INFO os_vif [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') Jun 09 11:50:38.297961 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:38.304091 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:38.318324 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:38.326927 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.336741 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.344757 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.360955 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.363601 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.363972 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.376283 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:38.389217 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:50:38.425763 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.40.100,3260] Jun 09 11:50:38.425763 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.40.100,3260] successful. Jun 09 11:50:38.425763 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.431699 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.50.100,3260] Jun 09 11:50:38.431699 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.50.100,3260] successful. Jun 09 11:50:38.431699 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.441077 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.453240 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.470570 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:38.470997 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:38.471432 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:38.474285 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] HCTL ('17', '-', '-', 0) found on session 39 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:38.474285 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.481969 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:38.482591 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:38.484420 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:38.484420 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:38.484944 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] HCTL ('18', '-', '-', 0) found on session 40 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:38.485706 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:38.506656 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 39 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:38.506656 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:38.506656 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Searching for a device in session 40 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:38.506656 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:38.678791 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:38.772656 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Successfully updated port: f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:38.813912 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Updating instance_info_cache with network_info: [{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:38.862996 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:38.864325 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing instance network info cache due to event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:38.864864 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:38.865794 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:38.867001 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:38.867001 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:38.869707 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:38.893824 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Booting with volume 2750a3aa-fc22-4517-880b-1707f8289e41 at /dev/vda Jun 09 11:50:38.943720 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:38.956170 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:50:38.980052 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:39.019594 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:50:39.019928 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:50:39.028206 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:50:39.029828 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a'] Jun 09 11:50:39.030007 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:50:39.030081 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:50:39.030557 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:39.030862 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating existing volume attachment record: e0e7f5c8-2b69-4d8b-90b7-4f93c9c1f258 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:50:39.257532 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:50:39.278745 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:39.316548 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Releasing lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:39.316986 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance network_info: |[{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:50:39.319517 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Start _get_guest_xml network_info=[{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:39.323156 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:39.324980 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-1270905940', uuid='0552b995-0c80-4506-958f-14067c64e393'), owner=OwnerMeta(userid='3014eb93944045468f25c84897e09e9d', username='tempest-ServerActionsTestOtherA-292149515-project-member', projectid='2e4846fa228b4be9829a4e85eabc18a2', projectname='tempest-ServerActionsTestOtherA-292149515'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005839.3245223) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:39.325965 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:39.326398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:39.327104 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:39.327434 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:39.328635 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:39.329221 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:39.329422 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:39.329544 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:39.329697 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:39.329838 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:39.329962 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:39.330158 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:39.330322 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:39.330612 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:39.330612 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:39.330737 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:39.345770 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1270905940',display_name='tempest-tempest.common.compute-instance-1270905940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-tempest-common-compute-instance-1270905940',id=26,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5s6Wa/9l4tj/v0h6y9sjfwgFL4+2+gpb2bYNcfLR3ebaIMojlYSYHpAcYCts/4NwdkYgKa39UM4iIxwrNNdoMIKEWdPuxrRs1cSJwpF+4AqoF5dGIqVXEloYr6jtBOXA==',key_name='tempest-keypair-1671411657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-bazpa0s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=0552b995-0c80-4506-958f-14067c64e393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:39.345957 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:39.346636 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:39.347277 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'pci_devices' on Instance uuid 0552b995-0c80-4506-958f-14067c64e393 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:39.374132 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:39.380599 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:39.462405 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.470773 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:39.654783 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:39.677781 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:50:39.800392 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:39.800503 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:39.800602 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] No VIF found with MAC fa:16:3e:f0:d7:8c, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:39.800976 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Using config drive Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] End _get_guest_xml xml= Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 0552b995-0c80-4506-958f-14067c64e393 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: instance-0000001a Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: tempest-tempest.common.compute-instance-1270905940 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 2026-06-09 11:50:39 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: True Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: bare Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-292149515-project-member Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-292149515 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 0552b995-0c80-4506-958f-14067c64e393 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 0552b995-0c80-4506-958f-14067c64e393 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: Jun 09 11:50:39.859740 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:39.861670 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Preparing to wait for external event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:39.861670 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:39.861670 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:39.861670 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:39.861779 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1270905940',display_name='tempest-tempest.common.compute-instance-1270905940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-tempest-common-compute-instance-1270905940',id=26,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5s6Wa/9l4tj/v0h6y9sjfwgFL4+2+gpb2bYNcfLR3ebaIMojlYSYHpAcYCts/4NwdkYgKa39UM4iIxwrNNdoMIKEWdPuxrRs1cSJwpF+4AqoF5dGIqVXEloYr6jtBOXA==',key_name='tempest-keypair-1671411657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-bazpa0s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=0552b995-0c80-4506-958f-14067c64e393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:39.862043 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:39.862900 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:39.863212 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:39.863500 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.863721 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:39.864292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:39.865390 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.865390 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a93571fd-3aeb-5101-a18d-e5478710ed1d', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:39.866747 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.867537 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:39.874323 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.882525 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.882525 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33bece78-1b, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:39.882917 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33bece78-1b, col_values=(('qos', UUID('2dac4e66-c247-4337-bb57-d5f9f7eb1fb9')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:39.883316 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33bece78-1b, col_values=(('external_ids', {'iface-id': '33bece78-1b53-425f-9be3-0e4229fdb64a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:0c:85', 'vm-uuid': '0552b995-0c80-4506-958f-14067c64e393'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:39.885534 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.886872 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.020s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:39.889661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.209s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:39.889661 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:50:39.893407 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:39.897002 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:39.898288 np0000002435 nova-compute[98325]: INFO os_vif [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') Jun 09 11:50:40.156314 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9b35e819-9bbe-4000-b893-9aabc4802aae req-bd4fb393-203d-4674-81cd-62434202bef5 service nova] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:40.156623 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:40.156807 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:40.275813 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Found WWN 33000000041759b88 for multipath device dm-9 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:50:40.276185 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:40.276409 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== connect_volume: return (5574ms) {'type': 'block', 'scsi_wwn': '33000000041759b88', 'path': '/dev/dm-9', 'multipath_id': '33000000041759b88'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:40.276592 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000041759b88', 'path': '/dev/dm-9', 'multipath_id': '33000000041759b88'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:50:40.306583 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:40.400756 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:40.407424 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:50:40.409368 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Claim successful on node np0000002435 Jun 09 11:50:40.413385 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:50:40.416057 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:50:40.416057 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:40.416057 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:40.464873 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Creating config drive at /opt/stack/data/nova/instances/6bd4cad7-4f07-44d4-be1b-c55da061851d/disk.config Jun 09 11:50:40.473506 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6bd4cad7-4f07-44d4-be1b-c55da061851d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps2hhzlm1 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:40.514702 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f77769f25d754bdb997c3cdf5b5e46e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8357a877b64741ce827b8108c288a358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:50:40.535744 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6bd4cad7-4f07-44d4-be1b-c55da061851d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps2hhzlm1" returned: 0 in 0.062s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:40.740801 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:40.782663 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.782663 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.783384 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.784181 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.784425 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.784787 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.785463 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.785609 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.786167 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.786545 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.786765 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.788339 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.788339 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.788339 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.788675 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.789125 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.789306 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.789690 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.790283 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:40.790490 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:40.790869 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:40.791550 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lazy-loading 'pci_devices' on Instance uuid 27d39b84-6464-471d-a472-d459193cba46 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:40.917510 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:50:40.923679 np0000002435 nova-compute[98325]: INFO nova.compute.resource_tracker [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating resource usage from migration 6a1fe326-bd27-4a59-9ccd-1c10d8fcc1c2 Jun 09 11:50:40.959973 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:41.027710 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.116736 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.123193 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.171635 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:50:41.176884 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:50:41.177252 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Creating image(s) Jun 09 11:50:41.177891 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:50:41.178060 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Ensure instance console log exists: /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:41.178430 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.178668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.178893 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.186524 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.218888 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:41.276466 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Successfully created port: feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] End _get_guest_xml xml= Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 27d39b84-6464-471d-a472-d459193cba46 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: instance-00000018 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: tempest-device-tagging-server-143407640 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 2026-06-09 11:50:27 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: True Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: bare Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: tempest-TaggedBootDevicesTest-1697688058-project-member Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: tempest-TaggedBootDevicesTest-1697688058 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 27d39b84-6464-471d-a472-d459193cba46 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 27d39b84-6464-471d-a472-d459193cba46 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: dc00fe60-f81d-4db8-b0ff-48fe626f166a Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: cccb28ff-e435-4216-b524-2a6ba0a79bdc Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: 7e5233d9-a5c9-4a9f-844c-c459559cd348 Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: Jun 09 11:50:41.295252 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:41.299125 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.299312 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.299504 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.299700 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.299883 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.299991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.300142 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.300415 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.300491 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.300611 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.301038 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.301038 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.301038 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.301297 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.301297 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.301420 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.301845 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.301845 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.301845 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.301944 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.302206 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.302206 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.304661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.304661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.304753 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Preparing to wait for external event network-vif-plugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:41.304851 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.305322 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.305322 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.306137 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.306347 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.306944 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.309426 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.310615 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.310909 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.311149 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.314031 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.314287 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '429dcd45-9cd3-5bc7-965a-b265c6af414c', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.316893 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.318395 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.323163 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.330054 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.330331 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb5b2c30-99, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.331973 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb5b2c30-99, col_values=(('qos', UUID('6a3a6abf-e546-4509-a7dc-e44d14613989')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.332176 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb5b2c30-99, col_values=(('external_ids', {'iface-id': 'db5b2c30-999a-4205-a9e3-0e05c15b24f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a8:4b', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.333335 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.335417 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.349293 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.353435 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.360684 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.360684 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18130a6a-b924-5b7d-a0cd-2a557db2e796', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.360684 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.362994 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.372457 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.375155 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.375595 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41e87f6a-f7, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.375711 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41e87f6a-f7, col_values=(('qos', UUID('8b1a3545-c830-4037-b7d4-a30b2970cc1c')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.375851 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41e87f6a-f7, col_values=(('external_ids', {'iface-id': '41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:20:ea', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.376946 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.381447 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.394198 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.395795 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') Jun 09 11:50:41.397518 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.397967 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.398801 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.401578 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.402737 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.402737 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.402737 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.409028 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.409028 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd3d09ed-3ffd-521b-8892-4df67bcbf852', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.410384 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.410384 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.428176 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.429565 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:50:41.434329 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.435477 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f0f3fbb-f8, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.436313 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f0f3fbb-f8, col_values=(('qos', UUID('ad3abfca-219a-4d7a-97d3-bde2acc4c768')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.436313 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f0f3fbb-f8, col_values=(('external_ids', {'iface-id': '5f0f3fbb-f84a-4eaa-9560-e874bfac6980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:9d:27', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.440454 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.449801 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:41.449801 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:41.449801 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No VIF found with MAC fa:16:3e:29:0c:85, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:41.449801 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Using config drive Jun 09 11:50:41.469734 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.471580 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') Jun 09 11:50:41.477701 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.478173 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.478749 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.479052 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.487063 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.487063 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.487063 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.498371 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.499568 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0739a2e2-ac4a-59aa-b6fa-ba8252402178', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.506103 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.519253 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.530892 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.536311 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.536311 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd09698b-88, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.536311 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd09698b-88, col_values=(('qos', UUID('eee507bd-3809-4a6c-8d36-ba11cd6854ac')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.536311 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd09698b-88, col_values=(('external_ids', {'iface-id': 'dd09698b-8819-4223-ba54-5997b963a450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:21:b2', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.539123 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.558254 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.561335 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.619312 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.621816 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') Jun 09 11:50:41.622219 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.622910 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.623168 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.623530 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.623819 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.624031 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.624275 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.629937 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.629937 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '661aa415-e7b2-5b9d-b542-66ab6900339c', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.631094 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.650381 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.678469 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.682363 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.682547 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cb0c616-4a, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.682846 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cb0c616-4a, col_values=(('qos', UUID('f7ff9784-da32-4021-92d1-844cc8406464')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.682973 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cb0c616-4a, col_values=(('external_ids', {'iface-id': '6cb0c616-4a6d-43a3-be75-4a37d5e762ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:db:b2', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.683822 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.686129 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.723725 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:41.728360 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance network_info: |[{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:50:41.729824 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Start _get_guest_xml network_info=[{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a1faf9d5-0b06-43ba-a171-aa1fa8337e07', 'attached_at': '', 'detached_at': '', 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'serial': '2750a3aa-fc22-4517-880b-1707f8289e41'}, 'attachment_id': 'e0e7f5c8-2b69-4d8b-90b7-4f93c9c1f258', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:41.740901 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:41.744189 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1216793261', uuid='a1faf9d5-0b06-43ba-a171-aa1fa8337e07'), owner=OwnerMeta(userid='a22b8c3e8e0442dbb1610a6c4711f534', username='tempest-TestShelveInstance-256112623-project-member', projectid='4788b73b12d54f048721db84c2083cea', projectname='tempest-TestShelveInstance-256112623'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005841.741996) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:41.748583 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.752332 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') Jun 09 11:50:41.752969 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.753129 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.753582 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.753770 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.754159 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:41.755001 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.755001 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.756662 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:41.757060 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.758599 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.760967 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4b48be5-a3a1-5d3c-99a5-64054578d55c', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.760967 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:41.761932 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:41.762881 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:41.765547 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:41.767314 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:41.767386 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.768105 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:41.768105 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:41.768105 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:41.768105 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:41.768338 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:41.768533 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:41.768533 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:41.771410 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:41.771410 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:41.776283 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.781862 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1a270cb7-79ee-4a98-a5ef-a9f2ae4f9a87 req-69eb3ac7-2bb1-4acd-9133-87b06389a7b9 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-plugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:41.783591 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1a270cb7-79ee-4a98-a5ef-a9f2ae4f9a87 req-69eb3ac7-2bb1-4acd-9133-87b06389a7b9 service nova] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:41.784365 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1a270cb7-79ee-4a98-a5ef-a9f2ae4f9a87 req-69eb3ac7-2bb1-4acd-9133-87b06389a7b9 service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:41.784720 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1a270cb7-79ee-4a98-a5ef-a9f2ae4f9a87 req-69eb3ac7-2bb1-4acd-9133-87b06389a7b9 service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:41.785400 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1a270cb7-79ee-4a98-a5ef-a9f2ae4f9a87 req-69eb3ac7-2bb1-4acd-9133-87b06389a7b9 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Processing event network-vif-plugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:41.787115 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:50:41.787815 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:41.787815 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:41.796015 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.804247 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.804247 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap972fd9d4-c4, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.804247 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap972fd9d4-c4, col_values=(('qos', UUID('af74e8f8-e6c3-4d23-9edf-ef4c6d3b66d5')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.804247 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap972fd9d4-c4, col_values=(('external_ids', {'iface-id': '972fd9d4-c41e-4586-a696-46db1e2103d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:2e:88', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.805329 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.807352 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.851768 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.855676 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') Jun 09 11:50:41.856863 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:41.857026 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:41.857528 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:41.857754 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:41.857988 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.858187 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.858434 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:41.859634 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.859797 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1ee349-a214-5b26-9f36-ecc6d797f773', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.861080 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.862350 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.888394 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.893994 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.894117 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ef25b9f-6e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.894433 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ef25b9f-6e, col_values=(('qos', UUID('7744fd0f-0cfd-449f-ac33-f4a0be485273')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.894644 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ef25b9f-6e, col_values=(('external_ids', {'iface-id': '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:c6:a6', 'vm-uuid': '27d39b84-6464-471d-a472-d459193cba46'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:41.895504 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.897427 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:41.929474 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:41.929763 np0000002435 nova-compute[98325]: INFO os_vif [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') Jun 09 11:50:41.944839 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:41.944839 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:41.963498 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:42.063351 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Successfully updated port: feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:50:42.123158 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Creating config drive at /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.config Jun 09 11:50:42.126460 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:42.127752 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing instance network info cache due to event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:42.128038 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:42.128534 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:42.129062 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:42.135437 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpttbhxo1p {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:42.154478 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:42.157608 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:42.157966 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] VM Started (Lifecycle Event) Jun 09 11:50:42.168564 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:50:42.174403 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Instance spawned successfully. Jun 09 11:50:42.174869 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:50:42.180300 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpttbhxo1p" returned: 0 in 0.046s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:42.443396 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:50:42.448529 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:42.459415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:50:42.459762 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Creating image(s) Jun 09 11:50:42.460722 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:42.460926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:42.461760 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:42.462364 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:42.467457 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:42.470537 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:42.549997 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.762s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:42.551453 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:50:42.563184 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.093s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:42.563725 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:42.564223 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:42.564699 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:42.572068 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:50:42.573290 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:42.574136 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:42.574572 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:42.575563 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:42.576280 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:42.576531 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:42.577704 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:42.577909 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:42.595347 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:42.595347 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:42.600602 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:50:42.600602 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41] added Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:42.611128 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:42.611431 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:42.611834 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:42.612043 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41] added Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:50:42.615117 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:42.615314 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:50:42.615461 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:50:42.616216 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:50:42.632078 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:42.668811 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:42.669829 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:42.690468 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:42.699978 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:42.707134 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:42.710374 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:42.710374 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:42.710374 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:42.710374 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:42.710374 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:42.722351 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:42.731932 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk 1073741824" returned: 0 in 0.058s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:42.731932 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:42.736789 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.170s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:42.736789 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:42.791080 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:42.840958 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.106s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:42.842214 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:50:42.842214 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:42.859461 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:42.951774 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:42.952704 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Cannot resize image /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:50:42.952909 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:50:42.955135 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Ensure instance console log exists: /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:42.955562 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:42.956237 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:42.956525 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:42.956713 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:42.964369 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.077s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:42.966229 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Migrating Jun 09 11:50:42.967384 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:50:43.015352 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:43.080584 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:43.207434 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:43.207849 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:43.207986 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] VM Paused (Lifecycle Event) Jun 09 11:50:43.216351 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Took 9.60 seconds to spawn the instance on the hypervisor. Jun 09 11:50:43.216522 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:43.475743 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:43.476215 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:43.476392 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] No VIF found with MAC fa:16:3e:f5:a8:4b, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:43.476665 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] No VIF found with MAC fa:16:3e:f1:db:b2, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:43.477457 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Using config drive Jun 09 11:50:43.498849 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:43.498974 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:43.499129 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:43.582684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-62c2bb6a-af32-4d27-8627-48065f99196d req-4efc055c-b17e-4013-99de-f377e0fc09c3 service nova] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:43.583308 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:43.583586 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:43.612645 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:43.618934 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:43.627991 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:43.637453 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.646668 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.651711 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.670150 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.670660 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.674985 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.675240 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:43.715598 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:43.722418 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:43.722634 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] VM Resumed (Lifecycle Event) Jun 09 11:50:43.728666 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.50.100,3260] Jun 09 11:50:43.728666 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.50.100,3260] successful. Jun 09 11:50:43.728666 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.729205 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Took 20.26 seconds to build instance. Jun 09 11:50:43.737452 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.40.100,3260] Jun 09 11:50:43.737452 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.40.100,3260] successful. Jun 09 11:50:43.737452 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.746679 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.751727 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.767665 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:43.768231 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:43.769482 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] HCTL ('20', '-', '-', 0) found on session 42 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:43.769554 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.775100 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:43.775609 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:43.776942 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] HCTL ('21', '-', '-', 0) found on session 43 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:43.777079 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:43.786019 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching for a device in session 42 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:43.786019 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:43.793360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching for a device in session 43 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:43.793360 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-plugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] No waiting events found dispatching network-vif-plugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received unexpected event network-vif-plugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 for instance with vm_state active and task_state None. Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Processing event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:43.880686 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:43.881593 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:43.882084 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:43.882539 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] No waiting events found dispatching network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:43.882539 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-70a0b9e6-eb80-4daf-b8f3-a50d19c48780 req-6b6e9792-14d5-48be-a04c-854f07efb5fe service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received unexpected event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a for instance with vm_state building and task_state spawning. Jun 09 11:50:43.886246 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:50:43.891659 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance spawned successfully. Jun 09 11:50:43.891914 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:50:43.992366 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:44.006044 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:44.193404 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Creating config drive at /opt/stack/data/nova/instances/27d39b84-6464-471d-a472-d459193cba46/disk.config Jun 09 11:50:44.199710 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27d39b84-6464-471d-a472-d459193cba46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9u2eci4l {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:44.230343 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:50:44.236457 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:44.236457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9705bcbc-11fb-4145-a8b2-e1d6a77fffec tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.780s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:44.244189 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:44.269674 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27d39b84-6464-471d-a472-d459193cba46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9u2eci4l" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:44.407890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:44.407890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:44.407890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:44.407890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:44.407890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:44.407890 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:44.505211 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:44.559799 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:44.580171 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:50:44.716659 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:44.752535 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:44.752771 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] VM Started (Lifecycle Event) Jun 09 11:50:44.856601 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:44.860423 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:44.919393 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Took 8.45 seconds to spawn the instance on the hypervisor. Jun 09 11:50:44.920333 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:44.920657 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:44.981629 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.089376 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.111620 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.117300 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.141402 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.141628 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.199241 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.225856 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:45.226213 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance network_info: |[{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:50:45.228407 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Start _get_guest_xml network_info=[{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:45.236708 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:45.237090 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1804171635', uuid='e1001828-c3fe-4a34-9f23-39d957daca78'), owner=OwnerMeta(userid='f77769f25d754bdb997c3cdf5b5e46e4', username='tempest-ServerRescueNegativeTestJSON-1703040470-project-member', projectid='8357a877b64741ce827b8108c288a358', projectname='tempest-ServerRescueNegativeTestJSON-1703040470'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005845.2366989) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:45.240382 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:45.240382 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:45.240444 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:45.240716 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:45.241546 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:45.241829 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:45.241966 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:45.242051 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:45.242171 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:45.242249 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:45.242400 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:45.243277 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:45.243277 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:45.243277 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:45.243277 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:45.243277 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:45.254336 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.262255 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:45.267420 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:45.275041 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804171635',display_name='tempest-ServerRescueNegativeTestJSON-server-1804171635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-1804171635',id=28,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJQH1lZhXKzpuCQUib7davmMydzZMn8qHPCLe7jxentPaDpFGAzmSipyPsTzcGsWYvbaec4dPt96R6lBV5j6LOhAhrWSZJlOdy5aLIbri0QEC/QmgVc/znk/9jneRwAYg==',key_name='tempest-keypair-1916647626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-oeymoxhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=e1001828-c3fe-4a34-9f23-39d957daca78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:45.275232 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:45.275919 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:6a,bridge_name='br-int',has_traffic_filtering=True,id=feddf54e-5a7b-4bff-9c76-c0540ef05ffb,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeddf54e-5a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:45.277563 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'pci_devices' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:45.282340 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.328168 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.332566 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-528935f9-cd7c-4335-a350-fe164c586623 req-4d7f3e47-c663-48cb-a792-9d09c6cc2d58 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:45.333033 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-528935f9-cd7c-4335-a350-fe164c586623 req-4d7f3e47-c663-48cb-a792-9d09c6cc2d58 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:45.333246 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-528935f9-cd7c-4335-a350-fe164c586623 req-4d7f3e47-c663-48cb-a792-9d09c6cc2d58 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:45.333431 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-528935f9-cd7c-4335-a350-fe164c586623 req-4d7f3e47-c663-48cb-a792-9d09c6cc2d58 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:45.334307 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-528935f9-cd7c-4335-a350-fe164c586623 req-4d7f3e47-c663-48cb-a792-9d09c6cc2d58 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:45.347906 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.350930 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.365353 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c5f26243-53e8-49ca-9bb7-0af800c9ca14 req-d67a66d8-e2fc-4203-9cd5-2145f27e8e96 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:45.365407 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c5f26243-53e8-49ca-9bb7-0af800c9ca14 req-d67a66d8-e2fc-4203-9cd5-2145f27e8e96 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:45.365698 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c5f26243-53e8-49ca-9bb7-0af800c9ca14 req-d67a66d8-e2fc-4203-9cd5-2145f27e8e96 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:45.367660 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c5f26243-53e8-49ca-9bb7-0af800c9ca14 req-d67a66d8-e2fc-4203-9cd5-2145f27e8e96 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:45.367660 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c5f26243-53e8-49ca-9bb7-0af800c9ca14 req-d67a66d8-e2fc-4203-9cd5-2145f27e8e96 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:45.367943 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:45.401790 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.405991 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.449752 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Took 18.83 seconds to build instance. Jun 09 11:50:45.493988 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.596662 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.603220 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.618680 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Found WWN 3300000008bedf4b3 for multipath device dm-10 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:50:45.619244 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.069s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:45.619434 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] <== connect_volume: return (3831ms) {'type': 'block', 'scsi_wwn': '3300000008bedf4b3', 'path': '/dev/dm-10', 'multipath_id': '3300000008bedf4b3'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:45.619648 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008bedf4b3', 'path': '/dev/dm-10', 'multipath_id': '3300000008bedf4b3'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:50:45.709486 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.746956 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.774224 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:45.774224 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] VM Paused (Lifecycle Event) Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] End _get_guest_xml xml= Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: e1001828-c3fe-4a34-9f23-39d957daca78 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: instance-0000001c Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-server-1804171635 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 2026-06-09 11:50:45 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: True Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: bare Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470-project-member Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: e1001828-c3fe-4a34-9f23-39d957daca78 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: e1001828-c3fe-4a34-9f23-39d957daca78 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: Jun 09 11:50:45.783457 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:45.785147 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Preparing to wait for external event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:45.785147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:45.785147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:45.785147 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:45.785147 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804171635',display_name='tempest-ServerRescueNegativeTestJSON-server-1804171635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-1804171635',id=28,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJQH1lZhXKzpuCQUib7davmMydzZMn8qHPCLe7jxentPaDpFGAzmSipyPsTzcGsWYvbaec4dPt96R6lBV5j6LOhAhrWSZJlOdy5aLIbri0QEC/QmgVc/znk/9jneRwAYg==',key_name='tempest-keypair-1916647626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-oeymoxhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=e1001828-c3fe-4a34-9f23-39d957daca78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:45.785388 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:45.787893 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:6a,bridge_name='br-int',has_traffic_filtering=True,id=feddf54e-5a7b-4bff-9c76-c0540ef05ffb,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeddf54e-5a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:45.788674 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:6a,bridge_name='br-int',has_traffic_filtering=True,id=feddf54e-5a7b-4bff-9c76-c0540ef05ffb,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeddf54e-5a') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:45.789134 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.789504 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:45.789827 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:45.795864 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.796250 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73d4d2a3-369f-5cbb-a943-7dad8628a7bd', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:45.797800 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.801033 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:45.811709 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.812357 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeddf54e-5a, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:45.812430 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfeddf54e-5a, col_values=(('qos', UUID('6728c130-2bab-4351-8d16-4b949dfccb56')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:45.812762 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfeddf54e-5a, col_values=(('external_ids', {'iface-id': 'feddf54e-5a7b-4bff-9c76-c0540ef05ffb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:56:6a', 'vm-uuid': 'e1001828-c3fe-4a34-9f23-39d957daca78'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:45.815041 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.816363 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:45.822030 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.822866 np0000002435 nova-compute[98325]: INFO os_vif [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:56:6a,bridge_name='br-int',has_traffic_filtering=True,id=feddf54e-5a7b-4bff-9c76-c0540ef05ffb,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeddf54e-5a') Jun 09 11:50:45.863654 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:45.958045 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-607db44e-ab72-4ddf-8da9-a2926ad33493 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.352s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:46.003644 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.013560 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.021554 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.056689 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.066419 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.131191 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1216793261',display_name='tempest-TestShelveInstance-server-1216793261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testshelveinstance-server-1216793261',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibqjvUo21bWIuqjRoDKcNs4xt/mUS6SWriRSjEuzeVI/bxaNHYglcTHwcu1CFR5nyfEBYG46naOltHNr1spYM6jYhJPPiPPpnDxpbMiUVn09EE2/yjnvzKoqBDs3IwYA==',key_name='tempest-TestShelveInstance-145988846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4788b73b12d54f048721db84c2083cea',ramdisk_id='',reservation_id='r-4t16a4b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-256112623',owner_user_name='tempest-TestShelveInstance-256112623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:38Z,user_data=None,user_id='a22b8c3e8e0442dbb1610a6c4711f534',uuid=a1faf9d5-0b06-43ba-a171-aa1fa8337e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:50:46.134483 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converting VIF {"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:46.134483 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:46.134483 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'pci_devices' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:46.281034 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:46.286762 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:46.286903 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] VM Resumed (Lifecycle Event) Jun 09 11:50:46.421714 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.427459 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:46.427459 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:46.427541 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:46.427629 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:46.427758 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:46.427877 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:46.427991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:46.428318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:46.428318 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:46.428541 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No event matching network-vif-plugged-dd09698b-8819-4223-ba54-5997b963a450 in dict_keys([('network-vif-plugged', '5f0f3fbb-f84a-4eaa-9560-e874bfac6980'), ('network-vif-plugged', '6cb0c616-4a6d-43a3-be75-4a37d5e762ee'), ('network-vif-plugged', '972fd9d4-c41e-4586-a696-46db1e2103d1'), ('network-vif-plugged', '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:50:46.432505 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-6addef24-c32f-4006-965a-9587a58bb369 req-07d093de-432c-40b4-9765-ff2dc4c376ad service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-dd09698b-8819-4223-ba54-5997b963a450 for instance with vm_state building and task_state spawning. Jun 09 11:50:46.432505 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] End _get_guest_xml xml= Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: instance-0000001b Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 196608 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: tempest-TestShelveInstance-server-1216793261 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 2026-06-09 11:50:41 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 192 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: True Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 0 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: virtio Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: tempest-TestShelveInstance-256112623-project-member Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: tempest-TestShelveInstance-256112623 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: hvm Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 128 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 1 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: 2750a3aa-fc22-4517-880b-1707f8289e41 Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Preparing to wait for external event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1216793261',display_name='tempest-TestShelveInstance-server-1216793261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testshelveinstance-server-1216793261',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibqjvUo21bWIuqjRoDKcNs4xt/mUS6SWriRSjEuzeVI/bxaNHYglcTHwcu1CFR5nyfEBYG46naOltHNr1spYM6jYhJPPiPPpnDxpbMiUVn09EE2/yjnvzKoqBDs3IwYA==',key_name='tempest-TestShelveInstance-145988846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4788b73b12d54f048721db84c2083cea',ramdisk_id='',reservation_id='r-4t16a4b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-256112623',owner_user_name='tempest-TestShelveInstance-256112623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:38Z,user_data=None,user_id='a22b8c3e8e0442dbb1610a6c4711f534',uuid=a1faf9d5-0b06-43ba-a171-aa1fa8337e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converting VIF {"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:46.640662 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:50:46.649000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.649000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:46.649000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:50:46.649000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.649000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dbd7d55-68ba-5673-929e-12a393aadfb4', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:46.649000 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.649798 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:46.681803 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.717934 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.720938 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.721152 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf750843d-d8, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:46.721498 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf750843d-d8, col_values=(('qos', UUID('434b4db0-754a-4fc1-b1df-99a30629e85d')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:46.724594 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf750843d-d8, col_values=(('external_ids', {'iface-id': 'f750843d-d81d-420f-a7f2-8cb43cccc274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:61:20', 'vm-uuid': 'a1faf9d5-0b06-43ba-a171-aa1fa8337e07'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:46.724594 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.724594 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:46.738592 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.743302 np0000002435 nova-compute[98325]: INFO os_vif [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') Jun 09 11:50:46.792142 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:46.798801 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:46.894896 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Starting migrate_disk_and_power_off {{(pid=98325) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12626}} Jun 09 11:50:46.948921 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.955444 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.960170 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.979846 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:46.999202 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.294158 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance destroyed successfully. Jun 09 11:50:47.295048 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=19,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=,launch_index=0,launched_at=2026-06-09T11:49:07Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-9xateyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=a2861c32-71b0-4b66-a389-6bb079d7624e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:50:47.295297 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:47.295796 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:47.296025 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:50:47.298488 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.298735 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e6b875f-6e, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:47.301803 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:47.301997 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] VM Started (Lifecycle Event) Jun 09 11:50:47.309034 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.311345 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:47.321764 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.324199 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.324199 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10f42587-8bc2-4114-86cf-6a88837abfbd) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:47.326535 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.327687 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:47.337958 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.341158 np0000002435 nova-compute[98325]: INFO os_vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') Jun 09 11:50:47.349456 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:47.349456 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:47.349456 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:fb:56:6a, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:47.349456 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Using config drive Jun 09 11:50:47.439959 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.454989 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.488798 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.499254 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.648991 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.650022 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.650424 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.650424 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.650534 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No event matching network-vif-plugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea in dict_keys([('network-vif-plugged', '5f0f3fbb-f84a-4eaa-9560-e874bfac6980'), ('network-vif-plugged', '6cb0c616-4a6d-43a3-be75-4a37d5e762ee'), ('network-vif-plugged', '972fd9d4-c41e-4586-a696-46db1e2103d1'), ('network-vif-plugged', '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:50:47.650632 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea for instance with vm_state building and task_state spawning. Jun 09 11:50:47.650778 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.650937 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.651943 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.652192 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.652366 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:47.652607 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.652824 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.653723 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.653940 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.654278 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No event matching network-vif-plugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee in dict_keys([('network-vif-plugged', '5f0f3fbb-f84a-4eaa-9560-e874bfac6980'), ('network-vif-plugged', '972fd9d4-c41e-4586-a696-46db1e2103d1'), ('network-vif-plugged', '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:50:47.654421 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee for instance with vm_state building and task_state spawning. Jun 09 11:50:47.654567 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.654838 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.655067 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.655282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.655478 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:47.655649 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.656233 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.656321 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.656564 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.656739 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No event matching network-vif-plugged-972fd9d4-c41e-4586-a696-46db1e2103d1 in dict_keys([('network-vif-plugged', '5f0f3fbb-f84a-4eaa-9560-e874bfac6980'), ('network-vif-plugged', '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:50:47.657289 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ac80a7c1-3632-41a5-b415-cafadb4cc791 req-609d8612-dae9-419e-af8d-205b12e63b24 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-972fd9d4-c41e-4586-a696-46db1e2103d1 for instance with vm_state building and task_state spawning. Jun 09 11:50:47.694289 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.694289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.694289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.694289 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.694289 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No event matching network-vif-plugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 in dict_keys([('network-vif-plugged', '5f0f3fbb-f84a-4eaa-9560-e874bfac6980'), ('network-vif-plugged', '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:50:47.694289 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 for instance with vm_state building and task_state spawning. Jun 09 11:50:47.696570 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.696570 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.696570 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.696570 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.696570 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:47.696861 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:47.697124 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:47.698531 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:47.698531 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:47.698531 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No event matching network-vif-plugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 in dict_keys([('network-vif-plugged', '9ef25b9f-6e2e-4716-986b-bac1f4bf61ab')]) {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 09 11:50:47.699891 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-1b24be42-f5c6-4655-9196-b806af327f4f req-8c40aa00-d0b6-4dd1-b269-06372d3953ff service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 for instance with vm_state building and task_state spawning. Jun 09 11:50:47.811458 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:47.814864 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:47.815061 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] VM Paused (Lifecycle Event) Jun 09 11:50:47.859226 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:47.862147 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.874686 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:47.910907 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Detected multiple connections on this host for volume: e08bd27e-dc7e-483b-9417-3238b78d1869, skipping target disconnect. Jun 09 11:50:47.915820 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:48.020524 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:48.021086 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:48.048286 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Creating config drive at /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.config Jun 09 11:50:48.052701 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzukywp6g {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:48.084966 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.093187 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.109659 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzukywp6g" returned: 0 in 0.057s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:48.131602 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:48.131954 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:50:48.132501 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e_resize/disk /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:48.241945 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "cp -r /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e_resize/disk /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:48.242250 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e_resize/disk.config /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:48.284722 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:48.284975 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:50:48.285156 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] No VIF found with MAC fa:16:3e:0c:61:20, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:50:48.286336 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Using config drive Jun 09 11:50:48.289756 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "cp -r /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e_resize/disk.config /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config" returned: 0 in 0.047s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:48.291696 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e_resize/disk.info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:48.322116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:48.327882 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:48.344903 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "cp -r /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e_resize/disk.info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" returned: 0 in 0.053s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:48.593746 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:48.593746 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:48.593991 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:48.594210 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:48.594407 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Processing event network-vif-plugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:48.594628 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-plugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-plugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received unexpected event network-vif-plugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab for instance with vm_state building and task_state spawning. Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-vif-unplugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:48.596292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:48.596661 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] No waiting events found dispatching network-vif-unplugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:48.596661 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received unexpected event network-vif-unplugged-1e6b875f-6eac-4420-a223-2c0bf4553264 for instance with vm_state active and task_state resize_migrating. Jun 09 11:50:48.596661 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-vif-unplugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:48.596815 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:48.596969 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:48.597106 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:48.598057 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] No waiting events found dispatching network-vif-unplugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:48.598796 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:48.598796 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-e7119dee-9e3c-4204-88c5-54b21f96bee2 req-50423b9d-9547-4a6e-8a3c-978e527c62eb service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received unexpected event network-vif-unplugged-1e6b875f-6eac-4420-a223-2c0bf4553264 for instance with vm_state active and task_state resize_migrating. Jun 09 11:50:48.608484 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:50:48.611980 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance spawned successfully. Jun 09 11:50:48.612216 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:50:48.721725 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.761147 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.798565 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:48.833304 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:48.836392 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.997861628999999 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:48.836618 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997061967999798 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:48.836855 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996840642999814 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:48.837248 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:48.837468 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] VM Resumed (Lifecycle Event) Jun 09 11:50:48.858720 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.948344 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.954695 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:48.972562 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Creating config drive at /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/disk.config Jun 09 11:50:48.974975 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy6o0fsac {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:49.044732 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy6o0fsac" returned: 0 in 0.070s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:49.126415 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:49.127180 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:49.127851 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:49.128034 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:49.128391 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:49.129986 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:49.271073 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:49.346520 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:49.350860 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:49.574037 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:49.582173 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:49.588973 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:49.621492 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:49.642675 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Took 34.77 seconds to spawn the instance on the hypervisor. Jun 09 11:50:49.643709 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:49.727786 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Port 1e6b875f-6eac-4420-a223-2c0bf4553264 binding to destination host np0000002435 is already ACTIVE {{(pid=98325) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 09 11:50:49.736127 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:49.853816 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 27d39b84-6464-471d-a472-d459193cba46] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:49.992455 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:49.992820 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Started (Lifecycle Event) Jun 09 11:50:50.055216 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:50.058503 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:50.069567 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:50.073181 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:50.096415 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:50.167828 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Took 48.40 seconds to build instance. Jun 09 11:50:50.409887 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:50.498863 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:50.504051 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:50.504236 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Paused (Lifecycle Event) Jun 09 11:50:50.669474 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a697f8fe-1b9f-4cec-a9fc-5375c6b185c2 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 49.906s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:50.690209 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-changed-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:50.690209 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Refreshing instance network info cache due to event network-changed-33bece78-1b53-425f-9be3-0e4229fdb64a. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:50.690209 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Acquiring lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:50.690209 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Acquired lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:50.690209 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Refreshing network info cache for port 33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:50.741045 np0000002435 nova-compute[98325]: DEBUG nova.compute.rpcapi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98325) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 09 11:50:50.756671 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:50.756847 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:50.757021 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:51.009794 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:51.013800 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:51.196328 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:51.496898 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:51.497093 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:51.497269 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:51.497442 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:51.497605 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:51.499637 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Terminating instance Jun 09 11:50:51.521192 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:51.522134 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:51.522134 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Started (Lifecycle Event) Jun 09 11:50:51.731963 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-changed-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:51.731963 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing instance network info cache due to event network-changed-db5b2c30-999a-4205-a9e3-0e05c15b24f3. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:51.731963 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] Acquiring lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:51.731963 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] Acquired lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:51.731963 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Refreshing network info cache for port db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:51.746232 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:51.775582 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:51.867489 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:51.867615 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:51.867746 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:50:51.916485 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Updated VIF entry in instance network info cache for port 33bece78-1b53-425f-9be3-0e4229fdb64a. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:50:51.916985 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Updating instance_info_cache with network_info: [{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:52.002845 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:50:52.025106 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:52.027621 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.032122 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:52.032335 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Paused (Lifecycle Event) Jun 09 11:50:52.037478 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.064748 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.065601 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.101055 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.243130 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:52.312527 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.322907 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.325980 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.334250 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Instance destroyed successfully. Jun 09 11:50:52.334677 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lazy-loading 'resources' on Instance uuid 6bd4cad7-4f07-44d4-be1b-c55da061851d {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:50:52.371451 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:52.419688 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Releasing lock "refresh_cache-0552b995-0c80-4506-958f-14067c64e393" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:52.419857 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:52.420023 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:52.420839 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:52.420978 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:52.421103 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Processing event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:52.421252 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:52.422577 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:52.422723 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:52.422835 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:52.423450 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:52.424216 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] No waiting events found dispatching network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:52.424216 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-df8dfe71-910d-417e-823f-69c2393619f5 req-f5f7a006-d5f1-414c-a4ca-1ab99dba6414 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received unexpected event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 for instance with vm_state building and task_state spawning. Jun 09 11:50:52.428282 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:50:52.431296 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance spawned successfully. Jun 09 11:50:52.433542 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:50:52.537500 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:52.540398 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99960358699991 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:50:52.540813 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:52.541131 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Resumed (Lifecycle Event) Jun 09 11:50:52.735360 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:52.827532 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-unplugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:52.828560 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:52.828777 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:52.828917 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:52.829116 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] No waiting events found dispatching network-vif-unplugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:52.830129 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-unplugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:50:52.830129 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-unplugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:52.830129 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] Acquiring lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:52.831146 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:52.831500 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:52.831677 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] No waiting events found dispatching network-vif-unplugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:52.833306 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-0c672425-d968-4b29-b482-3752d738e913 req-a78c9b1f-4341-4068-bfc5-f7cbaab182c3 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-unplugged-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:50:52.837607 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='instance-depend-image',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:50:43Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4a1b48558162488ca7f74f39eaea8192',ramdisk_id='',reservation_id='r-0o4p54ir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1916619139',owner_user_name='tempest-ImageDependencyTests-1916619139-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:43Z,user_data=None,user_id='ddf799345eda47c9a2a8251730b4b53f',uuid=6bd4cad7-4f07-44d4-be1b-c55da061851d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:50:52.838155 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Converting VIF {"id": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "address": "fa:16:3e:f0:d7:8c", "network": {"id": "70e76577-ad3c-42d9-ac94-9d273cf87191", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e566a50fe1584161a0c4580bfe83ebbb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0b4c0e-51", "ovs_interfaceid": "aa0b4c0e-5129-41cf-bcbf-b5b71cd47043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:50:52.839620 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:50:52.839949 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:50:52.841755 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.841823 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa0b4c0e-51, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:52.850191 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.850191 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:52.852910 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.853876 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:52.854839 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b99b48b4-0d22-439b-8632-d9625de28643) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:50:52.860681 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:52.871472 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:50:52.876154 np0000002435 nova-compute[98325]: INFO os_vif [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:d7:8c,bridge_name='br-int',has_traffic_filtering=True,id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043,network=Network(70e76577-ad3c-42d9-ac94-9d273cf87191),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0b4c0e-51') Jun 09 11:50:52.878454 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:50:52.878878 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:52.879175 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:52.879510 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:52.881567 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '742d8f55-5c2e-4a97-a694-267b213b2d5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:50:52.881801 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:52.924658 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:52.925139 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '43')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:50:52.925612 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', '37')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:50:52.927062 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d', '38')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:50:52.928393 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Resulting device map defaultdict(. at 0x77d8e04825c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'): ({'sdj'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:50:52.928662 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Removing multipathed devices sdj, sdk {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:50:52.929350 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Flush multipath device 330000000adf53e0d {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:50:52.961199 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:52.962063 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:52.962549 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:50:52.963701 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:52.963978 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:52.964298 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:52.964525 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:52.986674 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updated VIF entry in instance network info cache for port db5b2c30-999a-4205-a9e3-0e05c15b24f3. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:50:52.987153 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [{"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:53.009780 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:50:53.044434 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:53.054734 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:53.060809 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:50:53.060917 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:50:53.063021 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:50:53.075713 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:50:53.075953 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:50:53.088646 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:53.136273 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.40.100,3260] Jun 09 11:50:53.136273 np0000002435 nova-compute[98325]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.40.100,3260] successful. Jun 09 11:50:53.136273 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:53.141412 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:53.163056 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:53.178752 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:53.219940 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.50.100,3260] Jun 09 11:50:53.219940 np0000002435 nova-compute[98325]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-742d8f55-5c2e-4a97-a694-267b213b2d5d, portal: 192.168.50.100,3260] successful. Jun 09 11:50:53.219940 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:53.248077 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:53.248484 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:53.248791 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] <== disconnect_volume: return (369ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:53.249072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:50:53.249332 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Deleting instance files /opt/stack/data/nova/instances/6bd4cad7-4f07-44d4-be1b-c55da061851d_del Jun 09 11:50:53.249903 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Deletion of /opt/stack/data/nova/instances/6bd4cad7-4f07-44d4-be1b-c55da061851d_del complete Jun 09 11:50:53.471602 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Took 12.30 seconds to spawn the instance on the hypervisor. Jun 09 11:50:53.471897 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:53.492623 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-17fd52d2-181f-40d5-b5c2-1157b0e6e421 req-d23da9c7-61c1-4580-b67e-cc4092beee0f service nova] Releasing lock "refresh_cache-27d39b84-6464-471d-a472-d459193cba46" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:53.559314 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:53.647425 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:50:53.725623 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:53.760130 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Took 1.76 seconds to destroy the instance on the hypervisor. Jun 09 11:50:53.760599 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:50:53.761321 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:50:53.761321 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:50:53.762890 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:53.864489 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:53.984545 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Took 25.53 seconds to build instance. Jun 09 11:50:54.172806 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:54.194342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:50:54.226505 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:54.262619 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a1e533c1-d56a-47ff-9981-a3f37e61459b req-428ec024-fdd9-4de4-a09f-a43bb059e847 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Received event network-vif-deleted-aa0b4c0e-5129-41cf-bcbf-b5b71cd47043 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:54.263025 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-a1e533c1-d56a-47ff-9981-a3f37e61459b req-428ec024-fdd9-4de4-a09f-a43bb059e847 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Neutron deleted interface aa0b4c0e-5129-41cf-bcbf-b5b71cd47043; detaching it from the instance and deleting it from the info cache Jun 09 11:50:54.267206 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a1e533c1-d56a-47ff-9981-a3f37e61459b req-428ec024-fdd9-4de4-a09f-a43bb059e847 service nova] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Detach interface failed, port_id=aa0b4c0e-5129-41cf-bcbf-b5b71cd47043, reason: Instance 6bd4cad7-4f07-44d4-be1b-c55da061851d could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:50:54.280944 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:50:54.281227 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:50:54.289750 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:50:54.291665 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe0c:6120', 'fe80::682d:3aff:fe51:290b'] Jun 09 11:50:54.291814 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:50:54.291930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:50:54.292188 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:50:54.491670 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9f50d317-3272-4740-b46d-20b34edb4b83 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.042s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:54.691436 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:55.194655 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Took 1.43 seconds to deallocate network for instance. Jun 09 11:50:55.413961 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:55.495000 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Starting finish_migration {{(pid=98325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12813}} Jun 09 11:50:55.497871 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:50:55.498090 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Creating image(s) Jun 09 11:50:55.499383 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:55.610303 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:55.610788 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:50:55.611125 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:55.720566 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:55.721086 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Cannot resize image /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:50:55.779817 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Took 0.58 seconds to detach 1 volumes for instance. Jun 09 11:50:55.784073 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Deleting volume: 742d8f55-5c2e-4a97-a694-267b213b2d5d {{(pid=98325) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 09 11:50:56.227466 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:50:56.231110 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Ensure instance console log exists: /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:50:56.231110 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:56.231110 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:56.232293 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:56.236139 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Start _get_guest_xml network_info=[{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'a2861c32-71b0-4b66-a389-6bb079d7624e', 'attached_at': '2026-06-09T11:50:54.000000', 'detached_at': '', 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'multiattach': True, 'serial': 'e08bd27e-dc7e-483b-9417-3238b78d1869'}, 'attachment_id': 'b5a0c03b-d0ef-42c1-9ebd-a7df7fadf28b', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:50:56.245485 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:50:56.248536 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='a2861c32-71b0-4b66-a389-6bb079d7624e'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005856.2471104) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:50:56.252893 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:50:56.253188 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:50:56.256440 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:50:56.260518 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:50:56.261056 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:50:56.261439 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:50:56.263333 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:50:56.264075 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:50:56.264659 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:50:56.287567 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:50:56.361511 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:56.361688 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:56.406376 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:56.406989 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:56.408396 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:56.408560 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:56.408728 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Processing event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:50:56.411696 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:56.411696 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:56.411865 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:56.411865 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:56.412024 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:50:56.412024 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-d742f7dd-5d53-4395-9fe8-d861fbad7e68 req-e26e90c6-9d46-45c5-8eaa-300a5b964601 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state building and task_state spawning. Jun 09 11:50:56.413179 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:50:56.420494 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.config --force-share --output=json" returned: 0 in 0.133s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:50:56.421107 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:50:56.421758 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:50:56.422998 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:50:56.423370 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:50:56.423689 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Resumed (Lifecycle Event) Jun 09 11:50:56.428114 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "/opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.006s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:56.428806 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:50:56.429602 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:50:56.429602 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:56.431924 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance spawned successfully. Jun 09 11:50:56.432669 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:50:56.441929 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.012s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:56.442941 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:50:56.460717 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:56.461426 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:56.461752 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:50:56.462067 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:50:56.462459 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:50:56.462660 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:56.482662 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.startup = automatic Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.scan = manual Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:50:56.484504 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:56.499840 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:56.514629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('14', '0', '0', 0) found on session 28 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:56.532278 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.546405 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-560a7da6-f362-424f-89e6-a667f329e84d (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:50:56.546869 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:50:56.547194 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.086s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:50:56.547194 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:50:56.548440 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 28 and hctl ('14', '0', '0', 0) yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:56.548622 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:56.549538 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('13', '0', '0', 0) found on session 27 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:50:56.549667 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:50:56.560718 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 27 and hctl ('13', '0', '0', 0) yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:50:56.561099 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:50:56.930249 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:56.934710 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:50:56.950279 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:56.950279 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:56.950482 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:56.950665 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:56.951013 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:56.952584 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:50:57.277241 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:50:57.277241 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:50:57.438231 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:50:57.461907 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Took 15.02 seconds to spawn the instance on the hypervisor. Jun 09 11:50:57.462082 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:50:57.464719 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:50:57.781570 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:50:57.790626 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:57.858837 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:50:57.979729 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Took 22.10 seconds to build instance. Jun 09 11:50:58.290692 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.929s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:58.372329 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Deleted allocations for instance 6bd4cad7-4f07-44d4-be1b-c55da061851d Jun 09 11:50:58.483060 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-a6f73987-ce58-45b1-bd2e-99ff3cb87c12 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.613s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:58.490490 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:58.490663 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing instance network info cache due to event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:58.490918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:58.490918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:58.491085 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:59.000483 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:59.112151 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:50:59.112340 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing instance network info cache due to event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:50:59.112541 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:50:59.112682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:50:59.112836 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:50:59.390839 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-55adacdd-7199-4959-a402-7eb24002b288 tempest-ImageDependencyTests-1916619139 tempest-ImageDependencyTests-1916619139-project-member] Lock "6bd4cad7-4f07-44d4-be1b-c55da061851d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.894s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:50:59.416404 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:50:59.596230 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updated VIF entry in instance network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:50:59.596604 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:50:59.615217 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:00.030682 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:00.100429 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-68163a37-2f77-497c-b9c5-38ab536be22c req-98c614f6-6cce-4ac7-b962-c9f997f2eb0d service nova] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:00.197697 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updated VIF entry in instance network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:00.197950 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:00.415059 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:00.700067 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-97d1db66-9428-40c7-b431-f11818e61676 req-04f4cbba-3dd1-4368-bc04-c36b5f67ca01 service nova] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:02.860350 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:03.500348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:03.500570 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:03.834308 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005394250001700129 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:03.834504 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:03.834643 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.705420199999935 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:03.834757 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.705308119999927 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:03.834958 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-e4510c64-7c2f-4a77-80a2-8ad68421c226 None None] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:03.835311 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e4510c64-7c2f-4a77-80a2-8ad68421c226 None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] VM Stopped (Lifecycle Event) Jun 09 11:51:04.002539 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:51:04.338552 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e4510c64-7c2f-4a77-80a2-8ad68421c226 None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:04.339998 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e4510c64-7c2f-4a77-80a2-8ad68421c226 None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:04.500188 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 330000000b9a50607 for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:51:04.500468 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.059s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:04.500751 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (8070ms) {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:04.500942 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b9a50607', 'path': '/dev/dm-5', 'multipath_id': '330000000b9a50607'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:51:04.581497 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:04.581774 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:04.585333 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:51:04.585530 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Claim successful on node np0000002435 Jun 09 11:51:04.842329 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e4510c64-7c2f-4a77-80a2-8ad68421c226 None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 09 11:51:05.017119 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=19,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=,launch_index=0,launched_at=2026-06-09T11:49:07Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-9xateyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=a2861c32-71b0-4b66-a389-6bb079d7624e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:05.017647 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:05.018010 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] End _get_guest_xml xml= Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: a2861c32-71b0-4b66-a389-6bb079d7624e Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: instance-00000013 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 262144 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: multiattach-server-1 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 2026-06-09 11:50:56 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 256 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: True Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: bare Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: ide Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: pc Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: a2861c32-71b0-4b66-a389-6bb079d7624e Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: a2861c32-71b0-4b66-a389-6bb079d7624e Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: hvm Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 128 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: Jun 09 11:51:05.019985 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:51:05.022165 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002435',hostname='multiattach-server-1',id=19,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM27mi5rZ5rUlxxJEompuqSrNc2hjaBW96bfv5V4hqjP2klGLmp1syPEACV8z6gUWTOFYp4VKPTbfWR6UXwdIIDgTmZhEAiuVJxOknQgM9i8pOCkBNr0N2JlFCjL9C7dHg==',key_name='tempest-keypair-1131842330',keypairs=,launch_index=0,launched_at=2026-06-09T11:49:07Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002435',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-9xateyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=a2861c32-71b0-4b66-a389-6bb079d7624e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:51:05.022165 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "vif_mac": "fa:16:3e:3d:18:51"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:05.022165 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:05.022165 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:51:05.022484 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.023489 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:05.023489 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:51:05.024338 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.024502 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52c43327-679e-5015-9efc-5b7a32c503f3', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:05.025394 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.025964 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:05.027975 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.030532 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.030808 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e6b875f-6e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:05.031211 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e6b875f-6e, col_values=(('qos', UUID('5a0effa0-5d3a-4929-b956-3dc1503080d6')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:05.031468 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e6b875f-6e, col_values=(('external_ids', {'iface-id': '1e6b875f-6eac-4420-a223-2c0bf4553264', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:18:51', 'vm-uuid': 'a2861c32-71b0-4b66-a389-6bb079d7624e'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:05.032946 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.035152 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:05.042586 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:05.043954 np0000002435 nova-compute[98325]: INFO os_vif [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:18:51,bridge_name='br-int',has_traffic_filtering=True,id=1e6b875f-6eac-4420-a223-2c0bf4553264,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e6b875f-6e') Jun 09 11:51:05.418092 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:06.424323 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:06.424746 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:06.567391 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:06.567391 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:06.567391 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:06.567391 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:3d:18:51, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:06.567835 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Using config drive Jun 09 11:51:06.928279 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:07.030385 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:07.070948 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:07.079193 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:07.147625 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:07.217423 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:07.218818 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:07.295779 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-62c9c404-02c9-4ce2-b2f8-ab14296cee6e req-64e8982f-1b32-4072-b6ec-b91768f4ab64 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:07.296190 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-62c9c404-02c9-4ce2-b2f8-ab14296cee6e req-64e8982f-1b32-4072-b6ec-b91768f4ab64 service nova] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:07.296518 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-62c9c404-02c9-4ce2-b2f8-ab14296cee6e req-64e8982f-1b32-4072-b6ec-b91768f4ab64 service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:07.296752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-62c9c404-02c9-4ce2-b2f8-ab14296cee6e req-64e8982f-1b32-4072-b6ec-b91768f4ab64 service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:07.296957 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-62c9c404-02c9-4ce2-b2f8-ab14296cee6e req-64e8982f-1b32-4072-b6ec-b91768f4ab64 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] No waiting events found dispatching network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:07.297157 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-62c9c404-02c9-4ce2-b2f8-ab14296cee6e req-64e8982f-1b32-4072-b6ec-b91768f4ab64 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received unexpected event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 for instance with vm_state active and task_state resize_finish. Jun 09 11:51:07.435621 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.852s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:07.435621 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:51:07.540434 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00044503499998427287 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:07.540660 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:07.541973 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:07.541973 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] VM Stopped (Lifecycle Event) Jun 09 11:51:07.945350 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:51:07.946014 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:51:07.946250 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:07.946585 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:08.048118 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-02358f8c-8d6a-4143-9fe0-0d2a52d6b7d4 tempest-DeleteServersTestJSON-296745865 tempest-DeleteServersTestJSON-296745865-project-member] [instance: 6bd4cad7-4f07-44d4-be1b-c55da061851d] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:08.071026 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8a42aa4ff1541129a17ab41caff8de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c8b095803407d840bba1d5011fe4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:51:08.163123 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:08.163327 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] VM Resumed (Lifecycle Event) Jun 09 11:51:08.164738 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance event wait completed in 0 seconds for {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:51:08.167919 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Instance running successfully. Jun 09 11:51:08.169177 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Failed to set time: agent not configured {{(pid=98325) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 09 11:51:08.169352 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-63c9e22d-3271-4084-ba64-9398d10b26b2 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] finish_migration finished successfully. {{(pid=98325) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12908}} Jun 09 11:51:08.451865 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:51:08.666857 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:08.705544 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:08.867161 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Successfully created port: 068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:51:08.955227 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:51:09.208584 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 09 11:51:09.208892 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:09.209036 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] VM Started (Lifecycle Event) Jun 09 11:51:09.403625 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-74114a4b-e762-4ece-80ef-9169d30e8cca req-0dd4db0f-6345-408b-9359-532cec266a0a service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:09.403807 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-74114a4b-e762-4ece-80ef-9169d30e8cca req-0dd4db0f-6345-408b-9359-532cec266a0a service nova] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:09.404062 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-74114a4b-e762-4ece-80ef-9169d30e8cca req-0dd4db0f-6345-408b-9359-532cec266a0a service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:09.404500 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-74114a4b-e762-4ece-80ef-9169d30e8cca req-0dd4db0f-6345-408b-9359-532cec266a0a service nova] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:09.404500 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-74114a4b-e762-4ece-80ef-9169d30e8cca req-0dd4db0f-6345-408b-9359-532cec266a0a service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] No waiting events found dispatching network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:09.404500 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-74114a4b-e762-4ece-80ef-9169d30e8cca req-0dd4db0f-6345-408b-9359-532cec266a0a service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received unexpected event network-vif-plugged-1e6b875f-6eac-4420-a223-2c0bf4553264 for instance with vm_state resized and task_state None. Jun 09 11:51:09.605942 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Successfully updated port: 068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:51:09.651439 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:09.651776 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:09.652121 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Going to confirm migration 3 {{(pid=98325) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 09 11:51:09.669299 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-changed-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:09.669468 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Refreshing instance network info cache due to event network-changed-068c65da-c6ae-4431-8cc8-34b8b24f6f4d. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:09.669965 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] Acquiring lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:09.669965 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] Acquired lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:09.669965 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Refreshing network info cache for port 068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:09.711588 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:09.714352 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:09.965731 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:51:09.966794 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:51:09.967097 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Creating image(s) Jun 09 11:51:09.967534 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "/opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:09.967682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "/opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:09.968079 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "/opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:09.968697 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:09.971925 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:09.973280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:10.033239 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:10.066122 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.093s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:10.066793 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:10.067443 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:10.068019 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:10.072821 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:10.073452 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:10.110282 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:10.161089 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:10.173200 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:10.187763 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.114s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:10.188064 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:10.238532 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk 1073741824" returned: 0 in 0.050s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:10.239047 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.172s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:10.239443 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:10.295051 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:10.301028 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:10.301704 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:10.301880 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:10.302071 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:10.302323 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'info_cache' on Instance uuid a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:10.327968 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.088s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:10.328654 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:51:10.329120 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:10.420543 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:10.436179 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:10.439200 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Cannot resize image /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:51:10.440195 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:51:10.440487 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:51:10.440855 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:10.441090 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:10.441253 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:10.529943 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:11.034743 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c5ed361c-85ec-495f-adad-3e468dd5e770 req-f848d7dc-b19e-41a1-8bef-4f252973af5a service nova] Releasing lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:11.035488 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquired lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:11.035684 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:11.318304 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:11.665881 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:11.762679 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:11.915593 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:11.960592 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:12.083711 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updating instance_info_cache with network_info: [{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:12.464360 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:12.464360 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'migration_context' on Instance uuid a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:12.586564 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Releasing lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:12.587168 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Instance network_info: |[{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:51:12.592077 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Start _get_guest_xml network_info=[{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:51:12.598125 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:51:12.599908 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-742532993', uuid='9971a9c4-4000-45ee-90b3-88855b1e9c9c'), owner=OwnerMeta(userid='f8a42aa4ff1541129a17ab41caff8de1', username='tempest-TaggedAttachmentsTest-1193400979-project-member', projectid='ba3c8b095803407d840bba1d5011fe4d', projectname='tempest-TaggedAttachmentsTest-1193400979'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005872.5994537) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:51:12.602286 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:51:12.602286 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:51:12.603284 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:51:12.603523 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:51:12.604811 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:51:12.606385 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:51:12.607033 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:51:12.607033 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:51:12.607033 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:51:12.607157 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:51:12.624332 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-742532993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-742532993',id=29,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA35vEM+6OqXDR0JQG4cDBPDgdOrApIAreJCofMDPlXPp8kKchDPHqKG43+TSrj8dFvcp5aC9yvxAm4zT2dr4Bw2BlsISQwapJ7RuYZFUaN8iJ7TcZLuewNCfpyXuWqeA==',key_name='tempest-keypair-1101382972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c8b095803407d840bba1d5011fe4d',ramdisk_id='',reservation_id='r-0xaphmq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1193400979',owner_user_name='tempest-TaggedAttachmentsTest-1193400979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8a42aa4ff1541129a17ab41caff8de1',uuid=9971a9c4-4000-45ee-90b3-88855b1e9c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:12.624332 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converting VIF {"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:12.624332 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:c9,bridge_name='br-int',has_traffic_filtering=True,id=068c65da-c6ae-4431-8cc8-34b8b24f6f4d,network=Network(e9662547-c501-4617-8b73-4b4517ef0889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c65da-c6') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:12.624795 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'pci_devices' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:12.967472 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:12.974432 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:12.974907 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] End _get_guest_xml xml= Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 9971a9c4-4000-45ee-90b3-88855b1e9c9c Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: instance-0000001d Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 196608 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: tempest-device-tagging-server-742532993 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 2026-06-09 11:51:12 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 192 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: True Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: bare Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: tempest-TaggedAttachmentsTest-1193400979-project-member Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: tempest-TaggedAttachmentsTest-1193400979 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 9971a9c4-4000-45ee-90b3-88855b1e9c9c Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 9971a9c4-4000-45ee-90b3-88855b1e9c9c Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: hvm Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 128 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: Jun 09 11:51:13.130206 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Preparing to wait for external event network-vif-plugged-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-742532993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-742532993',id=29,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA35vEM+6OqXDR0JQG4cDBPDgdOrApIAreJCofMDPlXPp8kKchDPHqKG43+TSrj8dFvcp5aC9yvxAm4zT2dr4Bw2BlsISQwapJ7RuYZFUaN8iJ7TcZLuewNCfpyXuWqeA==',key_name='tempest-keypair-1101382972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c8b095803407d840bba1d5011fe4d',ramdisk_id='',reservation_id='r-0xaphmq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1193400979',owner_user_name='tempest-TaggedAttachmentsTest-1193400979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8a42aa4ff1541129a17ab41caff8de1',uuid=9971a9c4-4000-45ee-90b3-88855b1e9c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converting VIF {"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:c9,bridge_name='br-int',has_traffic_filtering=True,id=068c65da-c6ae-4431-8cc8-34b8b24f6f4d,network=Network(e9662547-c501-4617-8b73-4b4517ef0889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c65da-c6') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:c9,bridge_name='br-int',has_traffic_filtering=True,id=068c65da-c6ae-4431-8cc8-34b8b24f6f4d,network=Network(e9662547-c501-4617-8b73-4b4517ef0889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c65da-c6') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:13.135339 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:51:13.137183 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:13.137466 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a907c264-3e7d-5c3b-9e71-e97dc6a352cf', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:13.140901 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:13.142371 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:13.146524 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:13.146854 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068c65da-c6, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:13.147409 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068c65da-c6, col_values=(('qos', UUID('f8766534-0aa9-42f2-aa42-56b9e6235a19')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:13.147594 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068c65da-c6, col_values=(('external_ids', {'iface-id': '068c65da-c6ae-4431-8cc8-34b8b24f6f4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9a:c9', 'vm-uuid': '9971a9c4-4000-45ee-90b3-88855b1e9c9c'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:13.150213 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:13.151370 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:13.161220 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:13.162837 np0000002435 nova-compute[98325]: INFO os_vif [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:c9,bridge_name='br-int',has_traffic_filtering=True,id=068c65da-c6ae-4431-8cc8-34b8b24f6f4d,network=Network(e9662547-c501-4617-8b73-4b4517ef0889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c65da-c6') Jun 09 11:51:14.002572 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:14.002572 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:14.352911 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:14.353228 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:14.504732 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:51:14.682846 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:14.682993 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:14.683134 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No VIF found with MAC fa:16:3e:98:9a:c9, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:14.683704 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Using config drive Jun 09 11:51:14.855623 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:15.077999 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:15.193372 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:15.347094 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Creating config drive at /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk.config Jun 09 11:51:15.350849 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkx3ginqj {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:15.407055 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkx3ginqj" returned: 0 in 0.056s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:15.425298 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:15.872080 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.897s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:15.878251 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.794s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:15.885432 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:51:15.885432 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Claim successful on node np0000002435 Jun 09 11:51:15.898273 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:15.926773 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:16.039441 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:16.247738 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a83a0418-61cd-42bd-bd65-94d9fdc0e86c req-22a1ab3c-688d-47e9-bb23-9719cbd33980 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-vif-plugged-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:16.247924 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a83a0418-61cd-42bd-bd65-94d9fdc0e86c req-22a1ab3c-688d-47e9-bb23-9719cbd33980 service nova] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:16.248175 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a83a0418-61cd-42bd-bd65-94d9fdc0e86c req-22a1ab3c-688d-47e9-bb23-9719cbd33980 service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:16.248378 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a83a0418-61cd-42bd-bd65-94d9fdc0e86c req-22a1ab3c-688d-47e9-bb23-9719cbd33980 service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:16.248543 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a83a0418-61cd-42bd-bd65-94d9fdc0e86c req-22a1ab3c-688d-47e9-bb23-9719cbd33980 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Processing event network-vif-plugged-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:51:16.298043 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:16.336244 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:16.339655 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:16.536839 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Deleted allocation for migration 6a1fe326-bd27-4a59-9ccd-1c10d8fcc1c2 Jun 09 11:51:16.928973 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:51:16.931107 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:16.931107 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] VM Started (Lifecycle Event) Jun 09 11:51:16.936794 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:51:16.945763 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Instance spawned successfully. Jun 09 11:51:16.946217 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:51:17.045088 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc94-8c58-434c-ab5b-c5bd2a3010e5 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 7.393s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:17.434200 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:17.436177 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:17.462697 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:17.462853 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:17.463250 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:17.463534 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:17.463862 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:17.464166 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:17.770956 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:17.771480 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:17.798596 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:17.799531 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:51:17.938668 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:51:17.938976 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:17.939116 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] VM Paused (Lifecycle Event) Jun 09 11:51:17.968989 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Took 8.00 seconds to spawn the instance on the hypervisor. Jun 09 11:51:17.970776 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:18.149301 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:18.274388 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:18.323231 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9fde2027-322b-4e28-b8dd-d9c6042740bd req-ba679e4d-ba48-452e-94a5-e45381f2439a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-vif-plugged-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:18.323543 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9fde2027-322b-4e28-b8dd-d9c6042740bd req-ba679e4d-ba48-452e-94a5-e45381f2439a service nova] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:18.323727 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9fde2027-322b-4e28-b8dd-d9c6042740bd req-ba679e4d-ba48-452e-94a5-e45381f2439a service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:18.323853 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-9fde2027-322b-4e28-b8dd-d9c6042740bd req-ba679e4d-ba48-452e-94a5-e45381f2439a service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:18.327047 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9fde2027-322b-4e28-b8dd-d9c6042740bd req-ba679e4d-ba48-452e-94a5-e45381f2439a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] No waiting events found dispatching network-vif-plugged-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:18.327047 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-9fde2027-322b-4e28-b8dd-d9c6042740bd req-ba679e4d-ba48-452e-94a5-e45381f2439a service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received unexpected event network-vif-plugged-068c65da-c6ae-4431-8cc8-34b8b24f6f4d for instance with vm_state active and task_state None. Jun 09 11:51:18.394628 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Received event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:18.397413 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing instance network info cache due to event network-changed-e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:18.397413 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] Acquiring lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:18.397413 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] Acquired lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:18.397413 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Refreshing network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:18.441938 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:18.444546 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:18.444970 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] VM Resumed (Lifecycle Event) Jun 09 11:51:18.480997 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Took 13.97 seconds to build instance. Jun 09 11:51:18.783189 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.911s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:18.783700 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:51:18.799055 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:18.799497 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:18.799668 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:51:18.799985 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:51:18.899300 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:18.947593 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:18.950673 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:18.983116 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.482s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:19.266850 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:19.293991 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:51:19.294176 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:51:19.294378 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:19.294564 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:19.391057 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff5eaf239463498b816865f8320612ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '593f27604e8b460c869ab3e58ef2d858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:51:19.466744 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updated VIF entry in instance network info cache for port e7556c29-4189-4614-a64c-3b34768b7ad8. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:19.467086 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Updating instance_info_cache with network_info: [{"id": "e7556c29-4189-4614-a64c-3b34768b7ad8", "address": "fa:16:3e:7d:9f:81", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556c29-41", "ovs_interfaceid": "e7556c29-4189-4614-a64c-3b34768b7ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:19.791406 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:51:19.799788 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:19.799990 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:51:19.970060 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-102640a4-c525-4187-b836-70430b7b530c req-5e1c782e-ae86-4c6d-b3e1-effc0d3d2ea3 service nova] Releasing lock "refresh_cache-b6f3bff5-5831-44df-8fb2-55bb82329aab" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:20.083928 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Successfully created port: 17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:51:20.295570 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:51:20.426573 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:20.640747 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Received event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:20.640981 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing instance network info cache due to event network-changed-1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:20.641173 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] Acquiring lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:20.641324 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] Acquired lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:20.641462 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Refreshing network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:20.741529 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Successfully updated port: 17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:51:20.792499 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Received event network-changed-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:20.793200 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Refreshing instance network info cache due to event network-changed-17982c58-6a21-447a-bf6a-a54942e3775b. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:20.793432 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] Acquiring lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:20.793567 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] Acquired lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:20.794009 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Refreshing network info cache for port 17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:20.795215 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:20.795946 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:51:20.799456 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:20.803230 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:21.143922 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:21.243707 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:21.297284 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:21.306195 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:51:21.307233 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:51:21.307904 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Creating image(s) Jun 09 11:51:21.308882 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:21.309122 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "/opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:21.309785 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "/opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:21.310312 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:21.314177 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:21.314409 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:21.314560 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:21.314722 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:51:21.319620 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:21.320876 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:21.405769 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:21.419834 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.099s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:21.420192 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:21.420653 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:21.421144 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:21.423992 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:21.424587 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:21.526372 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.100s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:21.526372 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:21.554544 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:21.575290 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk 1073741824" returned: 0 in 0.050s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:21.575562 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.155s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:21.575820 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:21.606640 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:21.674246 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:21.674606 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:51:21.674840 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:21.748730 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updated VIF entry in instance network info cache for port 1e6b875f-6eac-4420-a223-2c0bf4553264. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:21.749280 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Updating instance_info_cache with network_info: [{"id": "1e6b875f-6eac-4420-a223-2c0bf4553264", "address": "fa:16:3e:3d:18:51", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e6b875f-6e", "ovs_interfaceid": "1e6b875f-6eac-4420-a223-2c0bf4553264", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:21.762726 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:21.763034 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Cannot resize image /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:51:21.763365 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:51:21.763553 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Ensure instance console log exists: /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:51:21.763834 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:21.764067 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:21.764205 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:22.112540 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-505820a6-11a5-4168-bfcd-58180f8600d2 req-f2752e5c-d0f3-4592-822b-d530c19c38c5 service nova] Releasing lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:22.114582 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquired lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:22.114756 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:22.252195 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] Releasing lock "refresh_cache-a2861c32-71b0-4b66-a389-6bb079d7624e" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:22.252943 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-changed-068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:22.253109 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Refreshing instance network info cache due to event network-changed-068c65da-c6ae-4431-8cc8-34b8b24f6f4d. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:22.253281 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] Acquiring lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:22.253390 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] Acquired lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:22.253516 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Refreshing network info cache for port 068c65da-c6ae-4431-8cc8-34b8b24f6f4d {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:22.415013 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:22.417300 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:22.511646 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:22.513456 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:22.609378 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:22.613581 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:22.702792 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:22.703392 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:22.726078 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:22.756358 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:22.790461 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2861c32-71b0-4b66-a389-6bb079d7624e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:22.791113 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:22.795638 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:22.886292 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:22.886695 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:22.974066 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:22.976968 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9971a9c4-4000-45ee-90b3-88855b1e9c9c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:22.983150 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.098248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.102962 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.153124 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:23.195009 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e03b1ab-e8ab-4fbe-8171-33617997b734/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.199444 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:23.199444 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:23.199852 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-9 (vdc) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:23.202708 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.229726 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Updating instance_info_cache with network_info: [{"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:23.300024 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.300826 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.329871 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:23.387714 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.391512 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.485542 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.486374 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.515136 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updated VIF entry in instance network info cache for port 068c65da-c6ae-4431-8cc8-34b8b24f6f4d. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:23.516764 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updating instance_info_cache with network_info: [{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:23.574320 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebcd1754-decd-470c-8d2f-1042b628a12f/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.577462 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:23.579135 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.667421 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json" returned: 0 in 0.088s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.668344 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.742726 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Releasing lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:23.742966 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Instance network_info: |[{"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:51:23.745779 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Start _get_guest_xml network_info=[{"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:51:23.753247 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:51:23.753247 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1421260058', uuid='ce77fb0b-4e58-4031-83b7-9fcef9a731f1'), owner=OwnerMeta(userid='ff5eaf239463498b816865f8320612ca', username='tempest-VolumesSnapshotTestJSON-635713327-project-member', projectid='593f27604e8b460c869ab3e58ef2d858', projectname='tempest-VolumesSnapshotTestJSON-635713327'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005883.7522254) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:51:23.754965 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:51:23.755503 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:51:23.756373 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:51:23.756634 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:51:23.758051 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:51:23.758908 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:51:23.758908 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:51:23.758908 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:51:23.759076 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:51:23.759104 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:51:23.759272 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:51:23.759573 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:51:23.759712 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:51:23.760357 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:51:23.760357 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:51:23.760454 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:51:23.777410 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk.rescue --force-share --output=json" returned: 0 in 0.109s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.779593 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.805030 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1421260058',display_name='tempest-VolumesSnapshotTestJSON-instance-1421260058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumessnapshottestjson-instance-1421260058',id=30,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCD9qYiex3upYF+6FN1qwDS8GoNeDlSfR5Q17VINCKnh1wYiw0MZteczVQUhbeLfB/WcOPMq5P/oF7u13rNREbV7ma44jaZv8gnwPTthoWYQsMZhP5DbAv9zIejmo8pkg==',key_name='tempest-keypair-2133406786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='593f27604e8b460c869ab3e58ef2d858',ramdisk_id='',reservation_id='r-nka2pemi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-635713327',owner_user_name='tempest-VolumesSnapshotTestJSON-635713327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff5eaf239463498b816865f8320612ca',uuid=ce77fb0b-4e58-4031-83b7-9fcef9a731f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:23.805399 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Converting VIF {"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:23.806849 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d5:bb,bridge_name='br-int',has_traffic_filtering=True,id=17982c58-6a21-447a-bf6a-a54942e3775b,network=Network(c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17982c58-6a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:23.808062 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lazy-loading 'pci_devices' on Instance uuid ce77fb0b-4e58-4031-83b7-9fcef9a731f1 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:23.875221 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.877085 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:23.989079 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ac82d8-f625-48e9-9dee-26835f0cc136/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:23.996203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.021699 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-5e4ca74c-8ee9-4562-8dfd-e7bd419aec59 req-d3c9872c-f55d-4f79-a4f9-be87ed3eb507 service nova] Releasing lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:24.093098 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.093589 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.204448 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b55628-1195-485f-910b-bf2d27fd4bd8/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.214779 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.311471 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.315899 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] End _get_guest_xml xml= Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: ce77fb0b-4e58-4031-83b7-9fcef9a731f1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: instance-0000001e Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 196608 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: tempest-VolumesSnapshotTestJSON-instance-1421260058 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 2026-06-09 11:51:23 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 192 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: True Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: bare Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: tempest-VolumesSnapshotTestJSON-635713327-project-member Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: tempest-VolumesSnapshotTestJSON-635713327 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: ce77fb0b-4e58-4031-83b7-9fcef9a731f1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: ce77fb0b-4e58-4031-83b7-9fcef9a731f1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: hvm Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 128 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: Jun 09 11:51:24.317895 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:51:24.321410 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Preparing to wait for external event network-vif-plugged-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:51:24.321410 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:24.321410 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:24.321410 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:24.321410 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1421260058',display_name='tempest-VolumesSnapshotTestJSON-instance-1421260058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-volumessnapshottestjson-instance-1421260058',id=30,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCD9qYiex3upYF+6FN1qwDS8GoNeDlSfR5Q17VINCKnh1wYiw0MZteczVQUhbeLfB/WcOPMq5P/oF7u13rNREbV7ma44jaZv8gnwPTthoWYQsMZhP5DbAv9zIejmo8pkg==',key_name='tempest-keypair-2133406786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='593f27604e8b460c869ab3e58ef2d858',ramdisk_id='',reservation_id='r-nka2pemi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-635713327',owner_user_name='tempest-VolumesSnapshotTestJSON-635713327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff5eaf239463498b816865f8320612ca',uuid=ce77fb0b-4e58-4031-83b7-9fcef9a731f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:51:24.322493 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Converting VIF {"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:24.322936 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d5:bb,bridge_name='br-int',has_traffic_filtering=True,id=17982c58-6a21-447a-bf6a-a54942e3775b,network=Network(c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17982c58-6a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:24.323417 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d5:bb,bridge_name='br-int',has_traffic_filtering=True,id=17982c58-6a21-447a-bf6a-a54942e3775b,network=Network(c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17982c58-6a') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:51:24.336856 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:24.338288 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:24.338986 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:51:24.344843 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:24.345228 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '264ccd93-916e-5447-992f-3a41e0785bb9', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:24.347481 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:24.348953 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:24.354743 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:24.355119 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17982c58-6a, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:24.355884 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17982c58-6a, col_values=(('qos', UUID('8ac881b9-a986-498a-9a55-17682a52fe43')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:24.356183 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17982c58-6a, col_values=(('external_ids', {'iface-id': '17982c58-6a21-447a-bf6a-a54942e3775b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:d5:bb', 'vm-uuid': 'ce77fb0b-4e58-4031-83b7-9fcef9a731f1'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:24.357292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:24.359554 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:24.367143 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:24.368994 np0000002435 nova-compute[98325]: INFO os_vif [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d5:bb,bridge_name='br-int',has_traffic_filtering=True,id=17982c58-6a21-447a-bf6a-a54942e3775b,network=Network(c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17982c58-6a') Jun 09 11:51:24.429118 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3d0e3a-0700-4b3d-8691-c30a18104acc/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.434384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.558408 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.561677 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.669230 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6f3bff5-5831-44df-8fb2-55bb82329aab/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.671398 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:51:24.672709 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:51:24.673847 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:24.715648 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "env LANG=C uptime" returned: 0 in 0.041s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:24.719286 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Hypervisor/Node resource view: name=np0000002435 free_ram=10323MB free_disk=74.06466293334961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}] {{(pid=98325) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 09 11:51:24.719286 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:24.719286 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:25.424056 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:25.424056 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:25.429723 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:25.795192 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 094562bc-f7ad-4b9a-a2cc-ca68d7b7c579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.795414 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 4b3d0e3a-0700-4b3d-8691-c30a18104acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.795643 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 91b55628-1195-485f-910b-bf2d27fd4bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.795788 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance ebcd1754-decd-470c-8d2f-1042b628a12f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.795922 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 5e03b1ab-e8ab-4fbe-8171-33617997b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.796048 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 15ac82d8-f625-48e9-9dee-26835f0cc136 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.796178 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance b6f3bff5-5831-44df-8fb2-55bb82329aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.796501 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 27d39b84-6464-471d-a472-d459193cba46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.796634 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 0552b995-0c80-4506-958f-14067c64e393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.796767 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance a1faf9d5-0b06-43ba-a171-aa1fa8337e07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.797030 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance e1001828-c3fe-4a34-9f23-39d957daca78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.797141 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance a2861c32-71b0-4b66-a389-6bb079d7624e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.797278 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.797649 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Instance ce77fb0b-4e58-4031-83b7-9fcef9a731f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98325) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 09 11:51:25.798278 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 09 11:51:25.798583 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Final resource view: name=np0000002435 phys_ram=24030MB used_ram=3328MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 11:51:24 up 34 min, 2 users, load average: 10.48, 6.52, 3.13\n', 'num_instances': '14', 'num_vm_active': '12', 'num_task_None': '13', 'num_os_type_None': '14', 'num_proj_9e3020791dcd4ef4b7980dd196a8ca96': '5', 'io_workload': '1', 'num_proj_2e4846fa228b4be9829a4e85eabc18a2': '2', 'num_proj_8357a877b64741ce827b8108c288a358': '3', 'num_vm_rescued': '1', 'num_proj_d28334e5ba844783948826494406371f': '1', 'num_proj_4788b73b12d54f048721db84c2083cea': '1', 'num_proj_ba3c8b095803407d840bba1d5011fe4d': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_593f27604e8b460c869ab3e58ef2d858': '1'} {{(pid=98325) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 09 11:51:25.896505 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:25.896639 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:25.896788 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No VIF found with MAC fa:16:3e:34:d5:bb, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:25.897301 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Using config drive Jun 09 11:51:25.928599 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'flavor' on Instance uuid 0552b995-0c80-4506-958f-14067c64e393 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:26.418304 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:26.482437 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:26.709921 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Creating config drive at /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk.config Jun 09 11:51:26.718075 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptm1rf42g {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:26.737952 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:26.738491 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:26.770235 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptm1rf42g" returned: 0 in 0.053s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:26.934909 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:27.238291 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:27.245529 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:27.267858 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:27.385366 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:27.631845 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2874bb7a-23bf-4ce1-80bf-b5cc3651eaad req-66729125-c40e-43f6-a855-32e9b0cca082 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Received event network-vif-plugged-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:27.631845 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2874bb7a-23bf-4ce1-80bf-b5cc3651eaad req-66729125-c40e-43f6-a855-32e9b0cca082 service nova] Acquiring lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:27.631845 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2874bb7a-23bf-4ce1-80bf-b5cc3651eaad req-66729125-c40e-43f6-a855-32e9b0cca082 service nova] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:27.631845 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-2874bb7a-23bf-4ce1-80bf-b5cc3651eaad req-66729125-c40e-43f6-a855-32e9b0cca082 service nova] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:27.631845 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-2874bb7a-23bf-4ce1-80bf-b5cc3651eaad req-66729125-c40e-43f6-a855-32e9b0cca082 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Processing event network-vif-plugged-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:51:27.658067 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:27.664869 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:27.691129 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:27.769040 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Compute_service record updated for np0000002435:np0000002435 {{(pid=98325) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 09 11:51:27.769040 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.052s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:27.769762 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:51:28.068909 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:28.069158 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:28.069451 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attaching volume 82564c96-c72d-4983-bad7-6995eb4c7ce9 to /dev/vdb Jun 09 11:51:28.138159 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:28.157354 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:51:28.191591 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:28.254330 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:51:28.256218 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:51:28.267965 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:51:28.271756 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe0c:6120', 'fe80::682d:3aff:fe51:290b', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e'] Jun 09 11:51:28.271958 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:51:28.272752 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:51:28.272752 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:28.272900 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Updating existing volume attachment record: 1ae8bb0c-a021-4159-9bfb-19f80475b7e0 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:51:28.277732 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:51:28.277995 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:28.278189 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] VM Started (Lifecycle Event) Jun 09 11:51:28.283228 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:51:28.293565 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Instance spawned successfully. Jun 09 11:51:28.294054 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:51:28.665670 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:28.765225 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:51:28.765567 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.03 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:51:28.791630 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:28.800931 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:28.809152 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:28.812703 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:28.812877 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:28.813242 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:28.813539 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:28.813861 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:28.814135 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:28.858588 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:51:28.858588 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:28.858588 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:28.858588 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:28.858588 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:51:28.872442 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:28.873874 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:28.874536 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:28.874929 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:28.875986 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:28.875986 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:28.889624 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:28.889624 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:28.896283 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:28.896283 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9] added Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:28.904464 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:28.904767 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:28.904862 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:28.905009 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9] added Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:28.913118 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:28.913507 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:28.914509 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:28.914509 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:29.311829 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:51:29.312176 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:29.312362 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] VM Paused (Lifecycle Event) Jun 09 11:51:29.324406 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Took 8.02 seconds to spawn the instance on the hypervisor. Jun 09 11:51:29.324642 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:29.358651 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:29.719131 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a6d25d11-11c3-4939-bf77-790d4079b019 req-6e782ed4-bf04-4c05-943f-56d51af3a392 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Received event network-vif-plugged-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:29.719595 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a6d25d11-11c3-4939-bf77-790d4079b019 req-6e782ed4-bf04-4c05-943f-56d51af3a392 service nova] Acquiring lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:29.719835 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a6d25d11-11c3-4939-bf77-790d4079b019 req-6e782ed4-bf04-4c05-943f-56d51af3a392 service nova] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:29.720002 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-a6d25d11-11c3-4939-bf77-790d4079b019 req-6e782ed4-bf04-4c05-943f-56d51af3a392 service nova] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:29.720131 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-a6d25d11-11c3-4939-bf77-790d4079b019 req-6e782ed4-bf04-4c05-943f-56d51af3a392 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] No waiting events found dispatching network-vif-plugged-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:29.720313 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-a6d25d11-11c3-4939-bf77-790d4079b019 req-6e782ed4-bf04-4c05-943f-56d51af3a392 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Received unexpected event network-vif-plugged-17982c58-6a21-447a-bf6a-a54942e3775b for instance with vm_state active and task_state None. Jun 09 11:51:29.815094 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:29.816701 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:29.816978 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] VM Resumed (Lifecycle Event) Jun 09 11:51:29.843882 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Took 14.83 seconds to build instance. Jun 09 11:51:29.905438 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:29.914631 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:29.916911 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:29.928908 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:29.937295 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:29.944236 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.956474 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.957051 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.968180 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:29.968655 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:30.021514 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.40.100,3260] Jun 09 11:51:30.021514 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.40.100,3260] successful. Jun 09 11:51:30.021514 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:30.030975 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.50.100,3260] Jun 09 11:51:30.030975 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.50.100,3260] successful. Jun 09 11:51:30.030975 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:30.039003 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:30.049692 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.069014 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:30.069537 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:30.070159 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:30.071180 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] HCTL ('15', '-', '-', 0) found on session 44 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:30.071383 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.072232 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:30.072743 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:30.073182 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:30.073182 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:30.077723 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] HCTL ('16', '-', '-', 0) found on session 45 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:30.077723 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:30.090547 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching for a device in session 44 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:30.090547 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:30.102320 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching for a device in session 45 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:30.102320 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:30.319922 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:30.321296 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:30.346906 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-91628127-5a88-4b81-bde7-530d22f00d96 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.344s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:30.433680 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:30.875554 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:51:31.644785 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Received event network-changed-17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:31.645682 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Refreshing instance network info cache due to event network-changed-17982c58-6a21-447a-bf6a-a54942e3775b. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:31.645941 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] Acquiring lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:31.646094 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] Acquired lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:31.646282 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Refreshing network info cache for port 17982c58-6a21-447a-bf6a-a54942e3775b {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:31.851961 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:31.893678 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Found WWN 33000000025a5cfe9 for multipath device dm-8 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:51:31.894204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:31.894204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000025a5cfe9', 'path': '/dev/dm-8', 'multipath_id': '33000000025a5cfe9'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:31.894363 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000025a5cfe9', 'path': '/dev/dm-8', 'multipath_id': '33000000025a5cfe9'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:51:31.897206 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'flavor' on Instance uuid 0552b995-0c80-4506-958f-14067c64e393 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:32.148813 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:32.401149 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attempting to attach volume 82564c96-c72d-4983-bad7-6995eb4c7ce9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] attach device xml: Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: 82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: Jun 09 11:51:32.404950 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:51:32.561020 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:32.746643 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Updated VIF entry in instance network info cache for port 17982c58-6a21-447a-bf6a-a54942e3775b. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:32.747070 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Updating instance_info_cache with network_info: [{"id": "17982c58-6a21-447a-bf6a-a54942e3775b", "address": "fa:16:3e:34:d5:bb", "network": {"id": "c2b62dd0-b0ff-4654-9ff1-a25c7583bf3d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2045506096-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "593f27604e8b460c869ab3e58ef2d858", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap17982c58-6a", "ovs_interfaceid": "17982c58-6a21-447a-bf6a-a54942e3775b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:33.249602 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1a4cf3a9-e021-4bb0-a708-f316960f247c req-c942d9fd-db05-45aa-a672-b93e90787801 service nova] Releasing lock "refresh_cache-ce77fb0b-4e58-4031-83b7-9fcef9a731f1" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:34.092362 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:34.092563 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:34.092750 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:34.092911 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No VIF found with MAC fa:16:3e:29:0c:85, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:34.232464 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" by "nova.compute.manager.ComputeManager.shelve_offload_instance..do_shelve_offload_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:34.232464 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance..do_shelve_offload_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:34.232464 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Shelve offloading Jun 09 11:51:34.361980 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:34.796103 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:35.127203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:35.127314 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:35.280509 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:35.285402 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:35.310792 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:35.347571 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:35.440635 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:35.597192 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.999608452999837 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:35.598738 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998080805999962 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:35.599060 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997811472999729 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:35.599686 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance destroyed successfully. Jun 09 11:51:35.599884 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'numa_topology' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:35.631722 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'flavor' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:35.673465 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-26e86000-87a9-4d42-90a9-0144082559d1 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "0552b995-0c80-4506-958f-14067c64e393" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.604s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:36.101701 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:36.104468 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:36.104626 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:36.104814 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:36.608907 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:36.642475 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:36.976740 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:37.156994 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:37.285719 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Rebuilding instance Jun 09 11:51:37.453992 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:37.659332 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:37.659691 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:37.660248 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:37.730062 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:37.732181 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:37.732181 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Attaching volume 06633652-be8a-45d3-84fe-df1fbdd24d7b to /dev/vdb Jun 09 11:51:37.797572 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:37.815973 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:51:37.845019 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:37.882518 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:51:37.883335 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:51:37.894175 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:51:37.897541 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e'] Jun 09 11:51:37.901319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:51:37.901319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:51:37.901319 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:37.901319 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating existing volume attachment record: d923b7a0-c4ce-49e2-91ac-8d57ff763f32 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:51:38.153966 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-cdfd2dff-12a8-4167-8f2c-ab2b01daabc4 req-5fb94833-16dd-4868-9c66-181fe7855516 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-vif-unplugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:38.153966 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-cdfd2dff-12a8-4167-8f2c-ab2b01daabc4 req-5fb94833-16dd-4868-9c66-181fe7855516 service nova] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:38.154212 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-cdfd2dff-12a8-4167-8f2c-ab2b01daabc4 req-5fb94833-16dd-4868-9c66-181fe7855516 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:38.154353 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-cdfd2dff-12a8-4167-8f2c-ab2b01daabc4 req-5fb94833-16dd-4868-9c66-181fe7855516 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:38.154542 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-cdfd2dff-12a8-4167-8f2c-ab2b01daabc4 req-5fb94833-16dd-4868-9c66-181fe7855516 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] No waiting events found dispatching network-vif-unplugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:38.154731 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-cdfd2dff-12a8-4167-8f2c-ab2b01daabc4 req-5fb94833-16dd-4868-9c66-181fe7855516 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received unexpected event network-vif-unplugged-f750843d-d81d-420f-a7f2-8cb43cccc274 for instance with vm_state active and task_state shelving. Jun 09 11:51:38.249304 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance destroyed successfully. Jun 09 11:51:38.249781 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'resources' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:38.460546 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:51:38.461136 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06633652-be8a-45d3-84fe-df1fbdd24d7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:38.462197 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:38.462976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:38.463484 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06633652-be8a-45d3-84fe-df1fbdd24d7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:51:38.479060 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:38.479922 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:38.480571 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:38.481788 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:38.482161 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:38.482698 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:38.491286 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.493098 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.502170 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:38.502170 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:38.502922 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:38.502922 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b] added Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:38.516016 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:38.518123 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:38.518123 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:38.518123 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:38.522043 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b] added Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:38.531454 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:38.531681 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:38.531821 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.051(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:38.531960 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:38.665255 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.676571 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.716448 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:38.716838 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:38.751701 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Object Instance lazy-loaded attributes: numa_topology,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:38.752392 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1216793261',display_name='tempest-TestShelveInstance-server-1216793261',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testshelveinstance-server-1216793261',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibqjvUo21bWIuqjRoDKcNs4xt/mUS6SWriRSjEuzeVI/bxaNHYglcTHwcu1CFR5nyfEBYG46naOltHNr1spYM6jYhJPPiPPpnDxpbMiUVn09EE2/yjnvzKoqBDs3IwYA==',key_name='tempest-TestShelveInstance-145988846',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:53Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4788b73b12d54f048721db84c2083cea',ramdisk_id='',reservation_id='r-4t16a4b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-256112623',owner_user_name='tempest-TestShelveInstance-256112623-project-member'},tags=,task_state='shelving',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:54Z,user_data=None,user_id='a22b8c3e8e0442dbb1610a6c4711f534',uuid=a1faf9d5-0b06-43ba-a171-aa1fa8337e07,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:51:38.753085 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converting VIF {"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:38.753790 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:38.754026 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:51:38.755255 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.755533 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf750843d-d8, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:38.756739 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.757473 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:38.762098 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.763131 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.763449 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=434b4db0-754a-4fc1-b1df-99a30629e85d) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:38.763826 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.764233 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:38.766346 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.768598 np0000002435 nova-compute[98325]: INFO os_vif [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') Jun 09 11:51:38.772597 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:51:38.772976 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:38.773194 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:38.773804 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:38.801815 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99965119999979 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:38.803410 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance destroyed successfully. Jun 09 11:51:38.867347 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Detaching volume 82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:38.902199 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attempting to driver detach volume 82564c96-c72d-4983-bad7-6995eb4c7ce9 from mountpoint /dev/vdb Jun 09 11:51:38.905858 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Found disk vdb by alias ua-82564c96-c72d-4983-bad7-6995eb4c7ce9 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:51:38.905968 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Attempting to detach device vdb from instance 0552b995-0c80-4506-958f-14067c64e393 from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] detach device xml: Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: 82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]:
Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: Jun 09 11:51:38.906175 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:51:38.910968 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Successfully detached device vdb from instance 0552b995-0c80-4506-958f-14067c64e393 from the persistent domain config. Jun 09 11:51:38.911672 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:51:38.911940 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:38.912071 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:39.068560 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:39.068740 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:39.219710 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:51:39.516952 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:39.527853 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.532435 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:39.542739 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:39.546940 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.560156 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.561016 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:39.571314 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Detaching volume e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.585638 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.585930 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:39.613472 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: b6f3bff5-5831-44df-8fb2-55bb82329aab] Attempting to driver detach volume e08bd27e-dc7e-483b-9417-3238b78d1869 from mountpoint /dev/vdb Jun 09 11:51:39.618832 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:51:39.624833 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:51:39.624957 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Attempting to detach device vdb from instance b6f3bff5-5831-44df-8fb2-55bb82329aab from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]:
Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: Jun 09 11:51:39.625184 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:51:39.626178 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b, portal: 192.168.50.100,3260] Jun 09 11:51:39.626178 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b, portal: 192.168.50.100,3260] successful. Jun 09 11:51:39.626178 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.634712 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance b6f3bff5-5831-44df-8fb2-55bb82329aab from the persistent domain config. Jun 09 11:51:39.635115 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] (1/8): Attempting to detach device vdb with device alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 from instance b6f3bff5-5831-44df-8fb2-55bb82329aab from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]:
Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: Jun 09 11:51:39.635534 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:51:39.638673 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.650938 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b, portal: 192.168.40.100,3260] Jun 09 11:51:39.650938 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b, portal: 192.168.40.100,3260] successful. Jun 09 11:51:39.650938 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] HCTL ('19', '-', '-', 0) found on session 46 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:39.661869 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:39.669698 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:39.675088 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching for a device in session 46 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:39.675088 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06633652-be8a-45d3-84fe-df1fbdd24d7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.697279 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:39.697826 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:39.699275 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] HCTL ('22', '-', '-', 0) found on session 47 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:39.699423 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:39.713294 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching for a device in session 47 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:39.713522 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06633652-be8a-45d3-84fe-df1fbdd24d7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:39.768340 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:39.768340 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:39.769572 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:51:39.769708 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Claim successful on node np0000002435 Jun 09 11:51:40.176176 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-e08bd27e-dc7e-483b-9417-3238b78d1869> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:51:40.179915 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 for instance b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:51:40.182495 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance b6f3bff5-5831-44df-8fb2-55bb82329aab from the live domain config. Jun 09 11:51:40.242419 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:40.242419 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing instance network info cache due to event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:40.242419 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:40.242896 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:40.242896 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:40.439939 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:40.480810 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:51:40.721554 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Detected multiple connections on this host for volume: e08bd27e-dc7e-483b-9417-3238b78d1869, skipping target disconnect. Jun 09 11:51:40.744940 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:41.102926 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:41.270716 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updated VIF entry in instance network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:41.271001 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": null, "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf750843d-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:41.274850 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid b6f3bff5-5831-44df-8fb2-55bb82329aab {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:41.490634 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:41.490836 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:41.499416 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Found WWN 330000000749d9da7 for multipath device dm-13 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:51:41.500092 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:41.500334 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000749d9da7', 'path': '/dev/dm-13', 'multipath_id': '330000000749d9da7'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:41.501532 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000749d9da7', 'path': '/dev/dm-13', 'multipath_id': '330000000749d9da7'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:51:41.502367 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.729s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:41.504342 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:51:41.505477 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:51:41.508795 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'flavor' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.539339 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:51:41.539740 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '43')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:41.540999 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '42')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:41.541895 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Resulting device map defaultdict(. at 0x77d909aa7b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'): ({'sdo'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:51:41.542062 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Removing multipathed devices sdo, sdp {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:51:41.542250 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Flush multipath device 3300000008bedf4b3 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:51:41.599239 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:51:41.643762 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:51:41.676760 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Checking to see if SCSI volumes sdo, sdp have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:51:41.676986 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] SCSI volumes sdo, sdp have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:51:41.679024 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Checking to see if device paths {'sdo', 'sdp'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:51:41.690082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Device paths {'sdo', 'sdp'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:51:41.690289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:51:41.701158 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:41.757171 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.40.100,3260] Jun 09 11:51:41.757171 np0000002435 nova-compute[98325]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.40.100,3260] successful. Jun 09 11:51:41.757171 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:41.773450 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-966c2db7-e343-4f00-8f38-dff3922c7be5 req-212fe03e-31a6-4acb-851f-6f90c90c74d9 service nova] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:41.785905 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:41.797241 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:41.840533 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.50.100,3260] Jun 09 11:51:41.840533 np0000002435 nova-compute[98325]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.50.100,3260] successful. Jun 09 11:51:41.840533 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:41.867776 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:41.867987 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:41.868090 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] <== disconnect_volume: return (3094ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:41.868189 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:51:41.868546 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Deleting instance files /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07_del Jun 09 11:51:41.868777 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.957s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:41.869115 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:51:41.869237 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:51:41.869811 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Deletion of /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07_del complete Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.905754 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:51:41.906082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '44')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:41.907178 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '45')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:41.908072 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Resulting device map defaultdict(. at 0x77d8e0619120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'): ({'sdk'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:51:41.908233 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Removing multipathed devices sdk, sdj {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:51:41.908552 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flush multipath device 33000000025a5cfe9 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:51:41.945006 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:51:41.986659 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:51:41.994522 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:42.015900 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Attempting to attach volume 06633652-be8a-45d3-84fe-df1fbdd24d7b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] attach device xml: Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: 06633652-be8a-45d3-84fe-df1fbdd24d7b Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: Jun 09 11:51:42.017176 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:51:42.040808 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:51:42.040923 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:51:42.042404 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:51:42.054828 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:51:42.054984 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:51:42.065666 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:42.106997 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.40.100,3260] Jun 09 11:51:42.106997 np0000002435 nova-compute[98325]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.40.100,3260] successful. Jun 09 11:51:42.106997 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:42.128117 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:42.138699 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:42.182675 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.50.100,3260] Jun 09 11:51:42.182675 np0000002435 nova-compute[98325]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.50.100,3260] successful. Jun 09 11:51:42.182675 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:42.207651 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:42.207856 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:42.207965 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] <== disconnect_volume: return (3296ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:42.208083 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:51:42.283593 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-45fbf436-81eb-4a61-ac50-0de902921431 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "b6f3bff5-5831-44df-8fb2-55bb82329aab" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.215s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:42.318306 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-vif-unplugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:42.318512 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:42.319202 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:42.319394 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:42.319576 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] No waiting events found dispatching network-vif-unplugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:42.319759 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received unexpected event network-vif-unplugged-f750843d-d81d-420f-a7f2-8cb43cccc274 for instance with vm_state active and task_state shelving. Jun 09 11:51:42.319928 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-vif-unplugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:42.320085 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:42.320245 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:42.320399 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:42.320574 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] No waiting events found dispatching network-vif-unplugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:42.324293 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received unexpected event network-vif-unplugged-33bece78-1b53-425f-9be3-0e4229fdb64a for instance with vm_state active and task_state rebuilding. Jun 09 11:51:42.324926 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-vif-unplugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:42.325089 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:42.325228 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:42.325374 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:42.325503 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] No waiting events found dispatching network-vif-unplugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:42.325606 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-847bae5a-5d86-4164-945d-2a48558b1b3c req-7fef8778-6edb-4659-8328-631f038b6c4e service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received unexpected event network-vif-unplugged-33bece78-1b53-425f-9be3-0e4229fdb64a for instance with vm_state active and task_state rebuilding. Jun 09 11:51:42.438348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "a2861c32-71b0-4b66-a389-6bb079d7624e" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:42.438601 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:42.502276 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.735s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:42.502823 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:51:42.943716 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Detaching volume e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:42.986066 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Attempting to driver detach volume e08bd27e-dc7e-483b-9417-3238b78d1869 from mountpoint /dev/vdb Jun 09 11:51:42.997610 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:51:42.999559 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found disk vdb by alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Attempting to detach device vdb from instance a2861c32-71b0-4b66-a389-6bb079d7624e from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]:
Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: Jun 09 11:51:43.001726 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:51:43.010041 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:51:43.010154 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:51:43.010369 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:43.011148 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:43.013989 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance a2861c32-71b0-4b66-a389-6bb079d7624e from the persistent domain config. Jun 09 11:51:43.014163 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] (1/8): Attempting to detach device vdb with device alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 from instance a2861c32-71b0-4b66-a389-6bb079d7624e from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] detach device xml: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: e08bd27e-dc7e-483b-9417-3238b78d1869 Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]:
Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: Jun 09 11:51:43.014375 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:51:43.081162 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a3dd3a1bf74488ebaa0b6c78d99af35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9614b352a405bb3aea1e60744dfd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:51:43.419633 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance destroyed successfully. Jun 09 11:51:43.420986 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1270905940',display_name='tempest-ServerActionsTestOtherA-server-1546549662',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-tempest-common-compute-instance-1270905940',id=26,image_ref='795ec91e-34a0-4d58-a3d0-045cbd2830a6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5s6Wa/9l4tj/v0h6y9sjfwgFL4+2+gpb2bYNcfLR3ebaIMojlYSYHpAcYCts/4NwdkYgKa39UM4iIxwrNNdoMIKEWdPuxrRs1cSJwpF+4AqoF5dGIqVXEloYr6jtBOXA==',key_name='tempest-keypair-1671411657',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:44Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-bazpa0s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='795ec91e-34a0-4d58-a3d0-045cbd2830a6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=0552b995-0c80-4506-958f-14067c64e393,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:51:43.421168 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:43.421850 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:43.422128 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:51:43.422921 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:43.423103 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33bece78-1b, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:43.425003 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:43.425837 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:43.426672 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:43.427531 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:43.427688 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dac4e66-c247-4337-bb57-d5f9f7eb1fb9) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:43.428188 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:43.428686 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:43.429782 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:43.434043 np0000002435 nova-compute[98325]: INFO os_vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') Jun 09 11:51:43.435316 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:51:43.435636 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:43.435776 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:43.436124 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:43.436583 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:51:43.436773 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:43.473036 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:43.473579 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:51:43.473995 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, 0): [] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:43.474513 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9') {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 09 11:51:43.474513 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, 0): [] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:43.474624 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9') {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 09 11:51:43.474758 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Resulting device map defaultdict(. at 0x77d8e0436de0>, {}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:51:43.474899 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Disconnecting from: [] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:51:43.475102 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.039s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:43.475235 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] <== disconnect_volume: return (39ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:43.475417 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:51:43.475688 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Deleting instance files /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393_del Jun 09 11:51:43.477849 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Deletion of /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393_del complete Jun 09 11:51:43.513358 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:51:43.542228 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Successfully created port: 04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:51:43.621750 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Deleted allocations for instance a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:51:43.685445 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:43.685847 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:43.687356 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:43.688457 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:fb:56:6a, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:44.018525 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:51:44.122001 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Successfully updated port: 04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:51:44.129902 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:44.130031 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:44.404659 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Received event network-changed-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:44.404783 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Refreshing instance network info cache due to event network-changed-04cc83e9-6880-42a9-9615-529f3b0e85b3. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:44.404926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] Acquiring lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:44.405049 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] Acquired lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:44.405192 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Refreshing network info cache for port 04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:44.489903 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Booting with volume 82564c96-c72d-4983-bad7-6995eb4c7ce9 at /dev/vdb Jun 09 11:51:44.540938 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:44.552877 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:51:44.579446 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:44.621290 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:51:44.621693 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:51:44.625929 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:44.630001 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:51:44.631763 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e'] Jun 09 11:51:44.631892 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:51:44.631971 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:51:44.632191 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:44.632380 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Updating existing volume attachment record: 81b08abb-ca7c-4252-a850-39b0ec18198e {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:51:44.910243 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:45.024541 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:45.028704 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:45.028951 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:45.033194 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:51:45.034784 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:51:45.035101 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Creating image(s) Jun 09 11:51:45.036128 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "/opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:45.037659 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "/opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:45.039169 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "/opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:45.039357 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "9b66cefe71344ff7d1d9492d78897b6d78d0df3e" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:45.040999 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "9b66cefe71344ff7d1d9492d78897b6d78d0df3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:45.226780 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:45.253914 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-27e2eca8-eb0e-4a7a-b13b-84150d5c1444 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "e1001828-c3fe-4a34-9f23-39d957daca78" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.523s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:45.402632 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:45.442829 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:45.534478 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:45.593459 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:45.595909 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:45.596203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:45.647910 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Rescuing Jun 09 11:51:45.647910 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:45.647910 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:45.647910 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:45.682505 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.part --force-share --output=json" returned: 0 in 0.086s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:45.682844 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] bcbd1521-6bd0-4024-a338-5fffe718b3ce was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:51:45.683509 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:51:45.683813 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.part /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:45.733007 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f776141a-2a6a-4ae4-942a-a7979c7044fb req-586227fe-1ebc-4d1d-9b37-22a6ccec76cb service nova] Releasing lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:45.733760 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquired lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:45.734016 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:45.830159 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.part /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.converted" returned: 0 in 0.146s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:45.835446 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:45.926011 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e.converted --force-share --output=json" returned: 0 in 0.090s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:45.926747 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "9b66cefe71344ff7d1d9492d78897b6d78d0df3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.887s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:45.927334 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:45.930657 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:45.931876 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:46.014783 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e --force-share --output=json" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:46.015393 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "9b66cefe71344ff7d1d9492d78897b6d78d0df3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:46.015995 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "9b66cefe71344ff7d1d9492d78897b6d78d0df3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:46.016685 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:46.023150 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:46.023810 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:46.045644 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.915s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:46.118817 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:46.119354 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e,backing_fmt=raw /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:46.154974 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:46.197867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e,backing_fmt=raw /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk 1073741824" returned: 0 in 0.078s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:46.198392 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "9b66cefe71344ff7d1d9492d78897b6d78d0df3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.182s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:46.198684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:46.211663 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e08bd27e-dc7e-483b-9417-3238b78d1869 for instance a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:51:46.212986 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-e08bd27e-dc7e-483b-9417-3238b78d1869> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:51:46.218960 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully detached device vdb from instance a2861c32-71b0-4b66-a389-6bb079d7624e from the live domain config. Jun 09 11:51:46.271277 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:51:46.271277 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:46.271587 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:46.272093 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:46.272366 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e08bd27e-dc7e-483b-9417-3238b78d1869', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:51:46.272502 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:51:46.296507 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b66cefe71344ff7d1d9492d78897b6d78d0df3e --force-share --output=json" returned: 0 in 0.098s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:46.297019 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:51:46.297159 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:46.319164 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869 (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:51:46.321731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '27')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:46.322684 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869', '28')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:51:46.324197 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Resulting device map defaultdict(. at 0x77d8e076c4a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'): ({'sdh'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:51:46.324582 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Removing multipathed devices sdi, sdh {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:51:46.325405 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flush multipath device 330000000b9a50607 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:51:46.360559 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:46.362718 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:51:46.394717 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:46.395211 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Cannot resize image /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:51:46.395601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:51:46.395781 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Ensure instance console log exists: /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:51:46.399555 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:46.399838 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:46.400025 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:46.406362 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:51:46.455820 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:51:46.456040 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:51:46.458178 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:51:46.470913 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:51:46.471178 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:51:46.483661 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:46.525443 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.40.100,3260] Jun 09 11:51:46.525443 np0000002435 nova-compute[98325]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.40.100,3260] successful. Jun 09 11:51:46.525443 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:46.549470 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:46.555216 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:46.555859 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e7d661b4-7595-4933-ac61-348f3c291651 tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance..do_shelve_offload_instance" :: held 12.324s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:46.556867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" acquired by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: waited 1.154s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:46.557078 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Unshelving Jun 09 11:51:46.567968 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:46.603329 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.50.100,3260] Jun 09 11:51:46.603329 np0000002435 nova-compute[98325]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-e08bd27e-dc7e-483b-9417-3238b78d1869, portal: 192.168.50.100,3260] successful. Jun 09 11:51:46.603329 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:46.615284 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:46.622658 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:46.622966 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:46.623129 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== disconnect_volume: return (351ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:46.623354 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: a2861c32-71b0-4b66-a389-6bb079d7624e] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:51:46.761686 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updating instance_info_cache with network_info: [{"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:46.764536 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:51:46.766368 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Creating image(s) Jun 09 11:51:46.766368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "/opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:46.766368 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "/opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:46.766712 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "/opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:46.766712 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "1638cbb0edfca37a576cb0c4d7063addd2e16def" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:46.766986 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "1638cbb0edfca37a576cb0c4d7063addd2e16def" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:46.771127 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:47.171253 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'flavor' on Instance uuid a2861c32-71b0-4b66-a389-6bb079d7624e {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:47.226843 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:47.229556 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:47.230088 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.part --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.266173 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Releasing lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:47.266783 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Instance network_info: |[{"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:51:47.269742 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Start _get_guest_xml network_info=[{"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:51:36Z,direct_url=,disk_format='qcow2',id=bcbd1521-6bd0-4024-a338-5fffe718b3ce,min_disk=0,min_ram=0,name='tempest-scenario-img--1284468181',owner='40a9614b352a405bb3aea1e60744dfd4',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:51:37Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bcbd1521-6bd0-4024-a338-5fffe718b3ce'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:51:47.273319 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:47.276639 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:51:47.278427 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bcbd1521-6bd0-4024-a338-5fffe718b3ce', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-312311442', uuid='53197df6-c8eb-4a07-8ee4-50146c8cd972'), owner=OwnerMeta(userid='4a3dd3a1bf74488ebaa0b6c78d99af35', username='tempest-TestMinimumBasicScenario-1698382388-project-member', projectid='40a9614b352a405bb3aea1e60744dfd4', projectname='tempest-TestMinimumBasicScenario-1698382388'), image=ImageMeta(id='bcbd1521-6bd0-4024-a338-5fffe718b3ce', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005907.2779267) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:51:47.280350 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:51:47.280805 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:51:47.282347 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:51:47.282566 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:51:47.283802 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:51:47.284245 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:51:36Z,direct_url=,disk_format='qcow2',id=bcbd1521-6bd0-4024-a338-5fffe718b3ce,min_disk=0,min_ram=0,name='tempest-scenario-img--1284468181',owner='40a9614b352a405bb3aea1e60744dfd4',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:51:37Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:51:47.284472 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:51:47.284613 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:51:47.284788 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:51:47.284920 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:51:47.285078 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:51:47.285310 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:51:47.285466 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:51:47.285637 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:51:47.285789 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:51:47.286004 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:51:47.303210 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-312311442',display_name='tempest-TestMinimumBasicScenario-server-312311442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testminimumbasicscenario-server-312311442',id=31,image_ref='bcbd1521-6bd0-4024-a338-5fffe718b3ce',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/NPrAtg55FO2XMEPHgR78jwTcdZIohhCrgWXDfFtNq4n1/SYrWOBvudpqZaDEoWBukmfQZ5v3JAi5EabG06lTiIC1nOACM79Q+LPgRvR9kKI7+T+wXyXb+DVRQLqYFA==',key_name='tempest-TestMinimumBasicScenario-1866457581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a9614b352a405bb3aea1e60744dfd4',ramdisk_id='',reservation_id='r-9v2ivzkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bcbd1521-6bd0-4024-a338-5fffe718b3ce',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1698382388',owner_user_name='tempest-TestMinimumBasicScenario-1698382388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:44Z,user_data=None,user_id='4a3dd3a1bf74488ebaa0b6c78d99af35',uuid=53197df6-c8eb-4a07-8ee4-50146c8cd972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:47.303591 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Converting VIF {"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:47.305622 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:df,bridge_name='br-int',has_traffic_filtering=True,id=04cc83e9-6880-42a9-9615-529f3b0e85b3,network=Network(62190d00-9e60-4f99-bc9d-190ddf7ae765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04cc83e9-68') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:47.305622 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lazy-loading 'pci_devices' on Instance uuid 53197df6-c8eb-4a07-8ee4-50146c8cd972 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:47.318876 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.part --force-share --output=json" returned: 0 in 0.089s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.319181 np0000002435 nova-compute[98325]: DEBUG nova.virt.images [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] 795ec91e-34a0-4d58-a3d0-045cbd2830a6 was qcow2, converting to raw {{(pid=98325) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 09 11:51:47.320076 np0000002435 nova-compute[98325]: DEBUG nova.privsep.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98325) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 09 11:51:47.320076 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.part /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.converted {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.501011 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.part /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.converted" returned: 0 in 0.181s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.512701 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.converted --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.573036 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Booting with volume 2750a3aa-fc22-4517-880b-1707f8289e41 at /dev/vda Jun 09 11:51:47.594816 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def.converted --force-share --output=json" returned: 0 in 0.082s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.595477 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "1638cbb0edfca37a576cb0c4d7063addd2e16def" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.828s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:47.596047 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:47.600717 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:47.602132 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.634389 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:47.648289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:51:47.668331 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.704248 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def --force-share --output=json" returned: 0 in 0.102s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.704661 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "1638cbb0edfca37a576cb0c4d7063addd2e16def" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:47.705488 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:51:47.705694 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "1638cbb0edfca37a576cb0c4d7063addd2e16def" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:47.705948 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:51:47.708147 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:47.712473 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:47.713193 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.729611 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:51:47.734256 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e'] Jun 09 11:51:47.734499 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:51:47.734585 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:51:47.734938 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:47.735246 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating existing volume attachment record: 35f9c124-943e-448f-bb0b-0dbef36dc212 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:51:47.804534 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def --force-share --output=json" returned: 0 in 0.091s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.804974 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def,backing_fmt=raw /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk 1073741824 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] End _get_guest_xml xml= Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 53197df6-c8eb-4a07-8ee4-50146c8cd972 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: instance-0000001f Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 196608 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: tempest-TestMinimumBasicScenario-server-312311442 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 2026-06-09 11:51:47 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 192 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: True Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: bare Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: tempest-TestMinimumBasicScenario-1698382388-project-member Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: tempest-TestMinimumBasicScenario-1698382388 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 53197df6-c8eb-4a07-8ee4-50146c8cd972 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 53197df6-c8eb-4a07-8ee4-50146c8cd972 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: hvm Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 128 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: Jun 09 11:51:47.818701 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Preparing to wait for external event network-vif-plugged-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-312311442',display_name='tempest-TestMinimumBasicScenario-server-312311442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testminimumbasicscenario-server-312311442',id=31,image_ref='bcbd1521-6bd0-4024-a338-5fffe718b3ce',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/NPrAtg55FO2XMEPHgR78jwTcdZIohhCrgWXDfFtNq4n1/SYrWOBvudpqZaDEoWBukmfQZ5v3JAi5EabG06lTiIC1nOACM79Q+LPgRvR9kKI7+T+wXyXb+DVRQLqYFA==',key_name='tempest-TestMinimumBasicScenario-1866457581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a9614b352a405bb3aea1e60744dfd4',ramdisk_id='',reservation_id='r-9v2ivzkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bcbd1521-6bd0-4024-a338-5fffe718b3ce',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1698382388',owner_user_name='tempest-TestMinimumBasicScenario-1698382388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:44Z,user_data=None,user_id='4a3dd3a1bf74488ebaa0b6c78d99af35',uuid=53197df6-c8eb-4a07-8ee4-50146c8cd972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Converting VIF {"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:47.822746 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:df,bridge_name='br-int',has_traffic_filtering=True,id=04cc83e9-6880-42a9-9615-529f3b0e85b3,network=Network(62190d00-9e60-4f99-bc9d-190ddf7ae765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04cc83e9-68') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:47.823839 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:df,bridge_name='br-int',has_traffic_filtering=True,id=04cc83e9-6880-42a9-9615-529f3b0e85b3,network=Network(62190d00-9e60-4f99-bc9d-190ddf7ae765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04cc83e9-68') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:51:47.823839 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.826369 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:47.826369 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:51:47.826596 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.826781 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d65b7a1-5740-5e54-a081-5f43bf025165', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:47.827791 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.828632 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:47.829710 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.833553 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.833808 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04cc83e9-68, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:47.834440 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04cc83e9-68, col_values=(('qos', UUID('444205eb-7027-4c54-ae75-1ffc7643882f')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:47.834843 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04cc83e9-68, col_values=(('external_ids', {'iface-id': '04cc83e9-6880-42a9-9615-529f3b0e85b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:5a:df', 'vm-uuid': '53197df6-c8eb-4a07-8ee4-50146c8cd972'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:47.836233 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.837583 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:47.842588 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:47.843860 np0000002435 nova-compute[98325]: INFO os_vif [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:df,bridge_name='br-int',has_traffic_filtering=True,id=04cc83e9-6880-42a9-9615-529f3b0e85b3,network=Network(62190d00-9e60-4f99-bc9d-190ddf7ae765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04cc83e9-68') Jun 09 11:51:47.861062 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def,backing_fmt=raw /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk 1073741824" returned: 0 in 0.056s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.861709 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "1638cbb0edfca37a576cb0c4d7063addd2e16def" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.156s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:47.862084 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:47.947036 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1638cbb0edfca37a576cb0c4d7063addd2e16def --force-share --output=json" returned: 0 in 0.085s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:47.947612 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk. size=1073741824 {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 09 11:51:47.948017 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:48.031130 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:48.031646 np0000002435 nova-compute[98325]: DEBUG nova.virt.disk.api [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Cannot resize image /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk to a smaller size. {{(pid=98325) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 09 11:51:48.032042 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:51:48.032286 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Ensure instance console log exists: /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:51:48.032585 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:48.032817 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:48.032990 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:48.035625 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Start _get_guest_xml network_info=[{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-09T11:44:37Z,direct_url=,disk_format='qcow2',id=795ec91e-34a0-4d58-a3d0-045cbd2830a6,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-06-09T11:44:40Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0552b995-0c80-4506-958f-14067c64e393', 'attached_at': '', 'detached_at': '', 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'serial': '82564c96-c72d-4983-bad7-6995eb4c7ce9'}, 'attachment_id': '81b08abb-ca7c-4252-a850-39b0ec18198e', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:51:48.038590 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jun 09 11:51:48.040248 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='795ec91e-34a0-4d58-a3d0-045cbd2830a6', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1546549662', uuid='0552b995-0c80-4506-958f-14067c64e393'), owner=OwnerMeta(userid='3014eb93944045468f25c84897e09e9d', username='tempest-ServerActionsTestOtherA-292149515-project-member', projectid='2e4846fa228b4be9829a4e85eabc18a2', projectname='tempest-ServerActionsTestOtherA-292149515'), image=ImageMeta(id='795ec91e-34a0-4d58-a3d0-045cbd2830a6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005908.0397995) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:51:48.041221 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:51:48.041642 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:51:48.042491 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:51:48.042707 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:51:48.043760 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:51:48.044051 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-09T11:44:37Z,direct_url=,disk_format='qcow2',id=795ec91e-34a0-4d58-a3d0-045cbd2830a6,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-06-09T11:44:40Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:51:48.044216 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:51:48.044322 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:51:48.044463 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:51:48.044541 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:51:48.044611 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:51:48.044771 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:51:48.044859 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:51:48.044960 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:51:48.045067 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:51:48.045221 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:51:48.045418 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0552b995-0c80-4506-958f-14067c64e393 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:48.189506 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-36343244-4a0b-45d2-badb-b489d7407e93 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "a2861c32-71b0-4b66-a389-6bb079d7624e" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.751s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:48.558856 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:51:48.559481 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:48.559481 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:48.559695 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:48.559841 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:51:48.574772 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:48.575105 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:48.575840 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:48.575840 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:48.577119 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:48.577119 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:48.590700 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:48.590700 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:48.596024 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:48.596024 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9] added Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:48.606985 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9] added Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:48.609933 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:48.610108 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:48.610321 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:48.610496 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:48.928964 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:48.932067 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:48.957991 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:49.088499 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:49.099670 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:49.122823 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-229b9190-2092-47a4-a6a3-51470beefc15 req-75449b95-f885-4aa4-bd34-509bd073bc54 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:49.123222 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-229b9190-2092-47a4-a6a3-51470beefc15 req-75449b95-f885-4aa4-bd34-509bd073bc54 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:49.123467 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-229b9190-2092-47a4-a6a3-51470beefc15 req-75449b95-f885-4aa4-bd34-509bd073bc54 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:49.124498 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-229b9190-2092-47a4-a6a3-51470beefc15 req-75449b95-f885-4aa4-bd34-509bd073bc54 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:49.124498 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-229b9190-2092-47a4-a6a3-51470beefc15 req-75449b95-f885-4aa4-bd34-509bd073bc54 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:49.124498 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-229b9190-2092-47a4-a6a3-51470beefc15 req-75449b95-f885-4aa4-bd34-509bd073bc54 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state active and task_state rescuing. Jun 09 11:51:49.249638 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99972625800001 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:49.250882 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance destroyed successfully. Jun 09 11:51:49.251372 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'numa_topology' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:49.365115 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:49.365115 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:49.365321 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No VIF found with MAC fa:16:3e:60:5a:df, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:49.365586 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Using config drive Jun 09 11:51:49.421753 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:49.422006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:49.423212 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'pci_requests' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:49.607428 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:49.610886 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:49.621365 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:49.626879 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.635911 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.641522 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.657589 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.658173 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.660504 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.660836 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:49.713783 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.40.100,3260] Jun 09 11:51:49.713783 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.40.100,3260] successful. Jun 09 11:51:49.713783 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.727790 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.50.100,3260] Jun 09 11:51:49.727790 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9, portal: 192.168.50.100,3260] successful. Jun 09 11:51:49.727790 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.728192 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.739722 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.748684 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:49.749138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:49.749600 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:49.750631 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] HCTL ('13', '-', '-', 0) found on session 48 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:49.750748 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:49.755850 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Attempting rescue Jun 09 11:51:49.756599 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98325) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.758911 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:49.759305 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:49.759643 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:49.759643 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:49.761051 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] HCTL ('14', '-', '-', 0) found on session 49 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:49.761200 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:49.766153 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance directory exists: not creating {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5227}} Jun 09 11:51:49.766153 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Creating image(s) Jun 09 11:51:49.766306 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:49.766636 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:49.767144 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "/opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:49.767426 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:49.774678 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching for a device in session 48 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:49.774909 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:49.783687 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Searching for a device in session 49 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:49.783818 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '82564c96-c72d-4983-bad7-6995eb4c7ce9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:49.872844 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:49.927186 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'numa_topology' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:50.045429 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Creating config drive at /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk.config Jun 09 11:51:50.048138 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9orbgsja {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:50.094010 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/53197df6-c8eb-4a07-8ee4-50146c8cd972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9orbgsja" returned: 0 in 0.045s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:50.269785 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:50.270594 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:50.273377 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:50.275433 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:50.275926 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:50.276282 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:50.281987 np0000002435 nova-compute[98325]: DEBUG oslo_utils.imageutils.format_inspector [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98325) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 09 11:51:50.283126 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:50.377781 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66 --force-share --output=json" returned: 0 in 0.095s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:50.378472 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.rescue {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:50.432112 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:51:50.432439 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Claim successful on node np0000002435 Jun 09 11:51:50.438162 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc105418ff4133ba84e4b92b41c7b93ff9e8f66,backing_fmt=raw /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.rescue" returned: 0 in 0.060s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:50.438666 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lock "fbc105418ff4133ba84e4b92b41c7b93ff9e8f66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.163s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:50.438883 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'migration_context' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:50.447577 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.557335 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.566333 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.577108 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:51:50.587485 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.597407 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005977129999337194 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:50.597531 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:50.597642 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.203786777000005 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:50.597744 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.2036681289996523 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:50.599953 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:50.599953 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Stopped (Lifecycle Event) Jun 09 11:51:50.708446 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.920124 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.927463 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.930007 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.942566 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:50.945001 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Created local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5373}} Jun 09 11:51:50.945684 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Start _get_guest_xml network_info=[{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:fb:56:6a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=) rescue={'image_id': 'b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:51:50.946845 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'resources' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:50.955158 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:50.958721 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:51.101733 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-57438298-2f77-4cd5-b403-0c3fb8e39453 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:51.188023 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:51.188324 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:51.244931 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:51.246756 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:51.246905 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:51.247053 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:51.247208 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:51.247416 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state active and task_state rescuing. Jun 09 11:51:51.247510 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Received event network-vif-plugged-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:51.247682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Acquiring lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:51.247826 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:51.248728 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:51.248851 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Processing event network-vif-plugged-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:51:51.249009 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Received event network-vif-plugged-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:51.249280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Acquiring lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:51.249409 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:51.249582 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:51.249801 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] No waiting events found dispatching network-vif-plugged-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:51.249842 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-1f8c5c72-3cd5-4e8e-b6f1-63e7199f2f15 req-e18e603d-7d94-45b3-b791-32108fc9e968 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Received unexpected event network-vif-plugged-04cc83e9-6880-42a9-9615-529f3b0e85b3 for instance with vm_state building and task_state spawning. Jun 09 11:51:51.440972 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:51.440972 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] VM Started (Lifecycle Event) Jun 09 11:51:51.442113 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:51:51.451409 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:51.451706 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:51:51.454361 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:51:51.455892 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1804171635', uuid='e1001828-c3fe-4a34-9f23-39d957daca78'), owner=OwnerMeta(userid='f77769f25d754bdb997c3cdf5b5e46e4', username='tempest-ServerRescueNegativeTestJSON-1703040470-project-member', projectid='8357a877b64741ce827b8108c288a358', projectname='tempest-ServerRescueNegativeTestJSON-1703040470'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:fb:56:6a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005911.4555078) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:51:51.456108 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Instance spawned successfully. Jun 09 11:51:51.456902 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:51:51.458660 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:51:51.459435 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:51:51.461788 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:51:51.462007 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:51:51.463119 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:51:51.463551 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-09T11:44:41Z,direct_url=,disk_format='qcow2',id=b8dcd603-8bb0-4f2a-bfa2-115620ecccb4,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='e566a50fe1584161a0c4580bfe83ebbb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-09T11:44:44Z,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:51:51.463758 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:51:51.463898 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:51:51.464076 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:51:51.464215 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:51:51.464397 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:51:51.464592 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:51:51.465093 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:51:51.465307 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:51:51.465470 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:51:51.465630 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:51:51.465823 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:51.598200 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Found WWN 33000000025a5cfe9 for multipath device dm-5 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:51:51.598715 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:51.598928 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000025a5cfe9', 'path': '/dev/dm-5', 'multipath_id': '33000000025a5cfe9'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:51.599069 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000025a5cfe9', 'path': '/dev/dm-5', 'multipath_id': '33000000025a5cfe9'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:51:51.690882 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Starting instance... {{(pid=98325) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 09 11:51:51.943521 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:51.945499 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:51.962969 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:51.963107 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:51.963361 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:51.963580 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:51.963804 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:51.964047 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:51.967723 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:51.978308 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1804171635',display_name='tempest-ServerRescueNegativeTestJSON-server-1804171635',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-serverrescuenegativetestjson-server-1804171635',id=28,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJQH1lZhXKzpuCQUib7davmMydzZMn8qHPCLe7jxentPaDpFGAzmSipyPsTzcGsWYvbaec4dPt96R6lBV5j6LOhAhrWSZJlOdy5aLIbri0QEC/QmgVc/znk/9jneRwAYg==',key_name='tempest-keypair-1916647626',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:57Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8357a877b64741ce827b8108c288a358',ramdisk_id='',reservation_id='r-oeymoxhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1703040470',owner_user_name='tempest-ServerRescueNegativeTestJSON-1703040470-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f77769f25d754bdb997c3cdf5b5e46e4',uuid=e1001828-c3fe-4a34-9f23-39d957daca78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:fb:56:6a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:51.978523 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converting VIF {"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "vif_mac": "fa:16:3e:fb:56:6a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:51.979030 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:56:6a,bridge_name='br-int',has_traffic_filtering=True,id=feddf54e-5a7b-4bff-9c76-c0540ef05ffb,network=Network(432e678d-fb3b-4bae-aa53-05be91cebcfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeddf54e-5a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:51.979527 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'pci_devices' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:52.105852 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1270905940',display_name='tempest-ServerActionsTestOtherA-server-1546549662',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-tempest-common-compute-instance-1270905940',id=26,image_ref='795ec91e-34a0-4d58-a3d0-045cbd2830a6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5s6Wa/9l4tj/v0h6y9sjfwgFL4+2+gpb2bYNcfLR3ebaIMojlYSYHpAcYCts/4NwdkYgKa39UM4iIxwrNNdoMIKEWdPuxrRs1cSJwpF+4AqoF5dGIqVXEloYr6jtBOXA==',key_name='tempest-keypair-1671411657',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:44Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-bazpa0s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='795ec91e-34a0-4d58-a3d0-045cbd2830a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=0552b995-0c80-4506-958f-14067c64e393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:52.106664 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:52.107158 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] End _get_guest_xml xml= Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 0552b995-0c80-4506-958f-14067c64e393 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: instance-0000001a Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 196608 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-server-1546549662 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 2026-06-09 11:51:48 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 192 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: True Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: bare Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-292149515-project-member Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: tempest-ServerActionsTestOtherA-292149515 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 0552b995-0c80-4506-958f-14067c64e393 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 0552b995-0c80-4506-958f-14067c64e393 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: hvm Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 128 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: 82564c96-c72d-4983-bad7-6995eb4c7ce9 Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: Jun 09 11:51:52.108546 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1270905940',display_name='tempest-ServerActionsTestOtherA-server-1546549662',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-tempest-common-compute-instance-1270905940',id=26,image_ref='795ec91e-34a0-4d58-a3d0-045cbd2830a6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5s6Wa/9l4tj/v0h6y9sjfwgFL4+2+gpb2bYNcfLR3ebaIMojlYSYHpAcYCts/4NwdkYgKa39UM4iIxwrNNdoMIKEWdPuxrRs1cSJwpF+4AqoF5dGIqVXEloYr6jtBOXA==',key_name='tempest-keypair-1671411657',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:44Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4846fa228b4be9829a4e85eabc18a2',ramdisk_id='',reservation_id='r-bazpa0s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='795ec91e-34a0-4d58-a3d0-045cbd2830a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-292149515',owner_user_name='tempest-ServerActionsTestOtherA-292149515-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3014eb93944045468f25c84897e09e9d',uuid=0552b995-0c80-4506-958f-14067c64e393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converting VIF {"id": "33bece78-1b53-425f-9be3-0e4229fdb64a", "address": "fa:16:3e:29:0c:85", "network": {"id": "cfd6607e-96dd-4be1-8cf5-e70c8b346368", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-26028632-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2e4846fa228b4be9829a4e85eabc18a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bece78-1b", "ovs_interfaceid": "33bece78-1b53-425f-9be3-0e4229fdb64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:52.111556 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:51:52.112804 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.113035 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a93571fd-3aeb-5101-a18d-e5478710ed1d', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:52.114005 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.114844 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:52.121974 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.124446 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.124771 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33bece78-1b, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:52.125116 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33bece78-1b, col_values=(('qos', UUID('ec24051c-d468-4639-9698-248ff838968f')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:52.125401 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33bece78-1b, col_values=(('external_ids', {'iface-id': '33bece78-1b53-425f-9be3-0e4229fdb64a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:0c:85', 'vm-uuid': '0552b995-0c80-4506-958f-14067c64e393'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:51:52.126304 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.127446 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:51:52.137384 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:52.138488 np0000002435 nova-compute[98325]: INFO os_vif [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:0c:85,bridge_name='br-int',has_traffic_filtering=True,id=33bece78-1b53-425f-9be3-0e4229fdb64a,network=Network(cfd6607e-96dd-4be1-8cf5-e70c8b346368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bece78-1b') Jun 09 11:51:52.279042 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:52.329371 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:52.329745 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:52.448087 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:51:52.448595 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:52.448595 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] VM Paused (Lifecycle Event) Jun 09 11:51:52.468736 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Took 7.44 seconds to spawn the instance on the hypervisor. Jun 09 11:51:52.468869 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:52.481286 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] End _get_guest_xml xml= Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: e1001828-c3fe-4a34-9f23-39d957daca78 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: instance-0000001c Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 196608 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-server-1804171635 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 2026-06-09 11:51:51 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 192 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: True Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: bare Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 0 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: ide Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: pc Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: virtio Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470-project-member Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: tempest-ServerRescueNegativeTestJSON-1703040470 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: e1001828-c3fe-4a34-9f23-39d957daca78 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: e1001828-c3fe-4a34-9f23-39d957daca78 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: hvm Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 128 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: 1 Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: Jun 09 11:51:52.482245 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:51:52.488403 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance destroyed successfully. Jun 09 11:51:52.832893 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:52.950600 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:52.952055 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:52.952301 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] VM Resumed (Lifecycle Event) Jun 09 11:51:52.976180 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Took 13.25 seconds to build instance. Jun 09 11:51:53.339316 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.917s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:53.339809 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.062s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:53.339993 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:53.343660 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98325) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 09 11:51:53.343985 np0000002435 nova-compute[98325]: INFO nova.compute.claims [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Claim successful on node np0000002435 Jun 09 11:51:53.402095 np0000002435 nova-compute[98325]: INFO nova.network.neutron [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating port f750843d-d81d-420f-a7f2-8cb43cccc274 with attributes {'binding:host_id': 'np0000002435', 'device_owner': 'compute:nova'} Jun 09 11:51:53.455981 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:53.457692 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:53.477577 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-e6352a92-c3aa-4ee0-8706-e4300b8ed5aa tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.761s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:53.654214 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:53.654427 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:53.654427 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:53.654552 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] No VIF found with MAC fa:16:3e:29:0c:85, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:53.654889 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Using config drive Jun 09 11:51:53.802229 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007184320002124878 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:53.802461 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:53.802461 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.446888682000008 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:53.802572 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.446787766999933 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:51:53.802875 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:53.803020 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] VM Stopped (Lifecycle Event) Jun 09 11:51:53.974691 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:53.974831 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:53.974990 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:54.005757 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:54.007130 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:54.007130 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:51:54.007130 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] No VIF found with MAC fa:16:3e:fb:56:6a, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:51:54.007130 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Using config drive Jun 09 11:51:54.075338 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:54.075491 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing instance network info cache due to event network-changed-f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:54.075615 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] Acquiring lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:54.162016 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0552b995-0c80-4506-958f-14067c64e393 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:54.305395 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:54.307367 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:54.476951 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:54.510138 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'ec2_ids' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:54.673281 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Object Instance<0552b995-0c80-4506-958f-14067c64e393> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:54.673281 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lazy-loading 'keypairs' on Instance uuid 0552b995-0c80-4506-958f-14067c64e393 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:54.812128 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-05f61878-2d64-44d0-81d7-82c40646b3b3 tempest-ServerBootFromVolumeStableRescueTest-252292105 tempest-ServerBootFromVolumeStableRescueTest-252292105-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jun 09 11:51:54.817739 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:54.975529 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:55.013957 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:55.014137 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'keypairs' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:55.174951 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Object Instance<0552b995-0c80-4506-958f-14067c64e393> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:55.178324 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jun 09 11:51:55.282561 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:51:55.282784 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:51:55.327587 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Creating config drive at /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.config Jun 09 11:51:55.331378 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5aoltnq9 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:55.380399 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0552b995-0c80-4506-958f-14067c64e393/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5aoltnq9" returned: 0 in 0.048s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:55.448704 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:55.479805 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:55.481401 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:51:55.481544 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] Acquired lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:55.481729 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Refreshing network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:51:55.483101 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Creating image(s) Jun 09 11:51:55.484280 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:51:55.484280 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Ensure instance console log exists: /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:51:55.484280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:55.484280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:55.484775 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:55.485122 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Start _get_guest_xml network_info=[{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a1faf9d5-0b06-43ba-a171-aa1fa8337e07', 'attached_at': '', 'detached_at': '', 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'serial': '2750a3aa-fc22-4517-880b-1707f8289e41'}, 'attachment_id': '35f9c124-943e-448f-bb0b-0dbef36dc212', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:51:55.487867 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:51:55.489217 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1216793261', uuid='a1faf9d5-0b06-43ba-a171-aa1fa8337e07'), owner=OwnerMeta(userid='a22b8c3e8e0442dbb1610a6c4711f534', username='tempest-TestShelveInstance-256112623-project-member', projectid='4788b73b12d54f048721db84c2083cea', projectname='tempest-TestShelveInstance-256112623'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005915.488739) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:51:55.491594 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:51:55.492072 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:51:55.495976 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:51:55.496236 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:51:55.497556 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:51:55.497942 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:51:55.498178 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:51:55.498352 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:51:55.499283 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:51:55.499440 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:51:55.499591 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:51:55.499813 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:51:55.499975 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:51:55.500176 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:51:55.500353 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:51:55.500538 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:51:55.500921 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:55.518723 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:55.524284 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:55.667508 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:55.667706 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:55.688810 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Creating config drive at /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.config.rescue Jun 09 11:51:55.692819 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0ayuv4zz {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:55.746748 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1001828-c3fe-4a34-9f23-39d957daca78/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0ayuv4zz" returned: 0 in 0.054s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:51:55.787812 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:51:55.876824 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:55.921597 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:55.927694 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:55.987918 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:56.005852 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Object Instance lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:56.016885 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:51:56.017275 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:56.017420 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:56.017782 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:56.017984 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:51:56.033871 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:56.034724 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:56.035566 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:56.035566 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:56.035920 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:56.036202 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:56.048591 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:56.048591 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:56.059289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:56.059289 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41] added Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:56.072890 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:56.073532 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:56.073532 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41] added Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:56.074855 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:56.075172 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:56.076424 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.081783 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.082467 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.172399 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lazy-loading 'flavor' on Instance uuid 53197df6-c8eb-4a07-8ee4-50146c8cd972 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:56.176700 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bc500595-ae2c-416d-9550-11bffc76635f req-c68ccfec-cbb9-482d-bd2d-7cb77a9f0474 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:56.177188 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bc500595-ae2c-416d-9550-11bffc76635f req-c68ccfec-cbb9-482d-bd2d-7cb77a9f0474 service nova] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:56.178077 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bc500595-ae2c-416d-9550-11bffc76635f req-c68ccfec-cbb9-482d-bd2d-7cb77a9f0474 service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:56.178077 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-bc500595-ae2c-416d-9550-11bffc76635f req-c68ccfec-cbb9-482d-bd2d-7cb77a9f0474 service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:56.178077 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-bc500595-ae2c-416d-9550-11bffc76635f req-c68ccfec-cbb9-482d-bd2d-7cb77a9f0474 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] No waiting events found dispatching network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:56.178077 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-bc500595-ae2c-416d-9550-11bffc76635f req-c68ccfec-cbb9-482d-bd2d-7cb77a9f0474 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received unexpected event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a for instance with vm_state active and task_state rebuild_spawning. Jun 09 11:51:56.299678 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.960s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:56.299917 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Start building networks asynchronously for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 09 11:51:56.384977 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:56.445856 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.483010 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.561629 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updated VIF entry in instance network info cache for port f750843d-d81d-420f-a7f2-8cb43cccc274. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:51:56.561629 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Updating instance_info_cache with network_info: [{"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:51:56.581727 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.644861 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:56.792174 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3ae36001-6e52-4181-8d93-94db664960fc req-f5993bc9-8ab1-4667-b56d-8fa0fbace925 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:56.793492 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3ae36001-6e52-4181-8d93-94db664960fc req-f5993bc9-8ab1-4667-b56d-8fa0fbace925 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:56.794530 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3ae36001-6e52-4181-8d93-94db664960fc req-f5993bc9-8ab1-4667-b56d-8fa0fbace925 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:56.796193 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3ae36001-6e52-4181-8d93-94db664960fc req-f5993bc9-8ab1-4667-b56d-8fa0fbace925 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:56.796193 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3ae36001-6e52-4181-8d93-94db664960fc req-f5993bc9-8ab1-4667-b56d-8fa0fbace925 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:56.796193 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-3ae36001-6e52-4181-8d93-94db664960fc req-f5993bc9-8ab1-4667-b56d-8fa0fbace925 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state active and task_state rescuing. Jun 09 11:51:56.806321 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Allocating IP information in the background. {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 09 11:51:56.806497 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:51:56.806797 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:56.807086 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:56.901134 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d422c8cd17d4fe5b548032f10c7c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3020791dcd4ef4b7980dd196a8ca96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:51:56.934422 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "interface-9971a9c4-4000-45ee-90b3-88855b1e9c9c-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:56.934613 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "interface-9971a9c4-4000-45ee-90b3-88855b1e9c9c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:56.934898 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'flavor' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:57.064234 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6a24c2a8-e30b-4b43-92b4-e36196e79d49 req-9525d74f-bcc3-40f4-bbaa-5299588ad9ca service nova] Releasing lock "refresh_cache-a1faf9d5-0b06-43ba-a171-aa1fa8337e07" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:51:57.073683 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:57.076464 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:57.088589 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:51:57.102756 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.110807 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.119441 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.131287 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.136201 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.137151 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.148778 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:57.188348 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.520s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:57.214103 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.40.100,3260] Jun 09 11:51:57.214103 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.40.100,3260] successful. Jun 09 11:51:57.214103 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.224322 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.50.100,3260] Jun 09 11:51:57.224322 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41, portal: 192.168.50.100,3260] successful. Jun 09 11:51:57.224322 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.227307 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.240011 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:57.253629 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:57.256139 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] HCTL ('15', '-', '-', 0) found on session 50 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:57.256282 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:57.269163 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:51:57.274583 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] HCTL ('16', '-', '-', 0) found on session 51 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:51:57.274583 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:51:57.286463 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching for a device in session 50 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:57.286922 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:57.289566 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:57.289779 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] VM Resumed (Lifecycle Event) Jun 09 11:51:57.293872 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance event wait completed in 0 seconds for {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:51:57.295641 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:51:57.298404 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 0552b995-0c80-4506-958f-14067c64e393] Instance spawned successfully. Jun 09 11:51:57.298751 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:51:57.304910 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Searching for a device in session 51 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:51:57.305409 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2750a3aa-fc22-4517-880b-1707f8289e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:51:57.313530 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 09 11:51:57.439127 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:57.470023 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1efa1c52-dab9-4e86-9bd8-42b7ec78ea7c tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:57.515933 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Successfully created port: 49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:51:57.641125 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'pci_requests' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:57.795050 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:57.798201 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:57.806704 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:57.806850 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:57.807541 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:57.807541 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:57.807830 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:57.808700 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:51:57.821636 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Start building block device mappings for instance. {{(pid=98325) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 09 11:51:58.036797 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:51:58.128058 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Successfully updated port: 49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:51:58.142893 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Object Instance<9971a9c4-4000-45ee-90b3-88855b1e9c9c> lazy-loaded attributes: flavor,pci_requests {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:51:58.143082 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] allocate_for_instance() {{(pid=98325) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 09 11:51:58.143343 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:58.143561 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:58.254133 np0000002435 nova-compute[98325]: DEBUG nova.policy [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8a42aa4ff1541129a17ab41caff8de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c8b095803407d840bba1d5011fe4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98325) authorize /opt/stack/nova/nova/policy.py:192}} Jun 09 11:51:58.259529 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ceed0412-3c8d-48e8-9ce0-0f011c533298 req-56bda8e6-0a93-4fc0-ae93-0b9acacdbf71 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:58.259713 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ceed0412-3c8d-48e8-9ce0-0f011c533298 req-56bda8e6-0a93-4fc0-ae93-0b9acacdbf71 service nova] Acquiring lock "0552b995-0c80-4506-958f-14067c64e393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:58.259890 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ceed0412-3c8d-48e8-9ce0-0f011c533298 req-56bda8e6-0a93-4fc0-ae93-0b9acacdbf71 service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:58.260043 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-ceed0412-3c8d-48e8-9ce0-0f011c533298 req-56bda8e6-0a93-4fc0-ae93-0b9acacdbf71 service nova] Lock "0552b995-0c80-4506-958f-14067c64e393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:58.260186 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-ceed0412-3c8d-48e8-9ce0-0f011c533298 req-56bda8e6-0a93-4fc0-ae93-0b9acacdbf71 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] No waiting events found dispatching network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:58.260341 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-ceed0412-3c8d-48e8-9ce0-0f011c533298 req-56bda8e6-0a93-4fc0-ae93-0b9acacdbf71 service nova] [instance: 0552b995-0c80-4506-958f-14067c64e393] Received unexpected event network-vif-plugged-33bece78-1b53-425f-9be3-0e4229fdb64a for instance with vm_state active and task_state rebuild_spawning. Jun 09 11:51:58.278459 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:58.278630 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:58.278841 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Attaching volume 9f5112c5-cab8-4523-9994-d3b84e13b102 to /dev/vdb Jun 09 11:51:58.301541 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jun 09 11:51:58.301655 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:58.302346 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] VM Started (Lifecycle Event) Jun 09 11:51:58.316429 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:58.325845 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Booting with volume 6722d98e-c3b5-40cd-8530-1e77e1d65498 at /dev/vda Jun 09 11:51:58.330590 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:58.346158 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:51:58.381380 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:58.404533 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:58.419082 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:51:58.429246 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:51:58.429520 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:51:58.440507 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:51:58.442875 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e', 'fe80::fc16:3eff:fe60:5adf', 'fe80::e454:63ff:fe15:5c57', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fefb:566a'] Jun 09 11:51:58.443083 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:51:58.443332 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:51:58.444381 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:58.444519 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updating existing volume attachment record: 717e64a6-f77f-401f-8cdb-12c116aa4b6d {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:51:58.454560 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:51:58.506798 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:51:58.506798 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:51:58.525359 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:51:58.532894 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fef5:a84b', 'fe80::fc16:3eff:fef1:20ea', 'fe80::ec4a:94ff:fe5e:ac62', 'fe80::fc16:3eff:fe5d:9d27', 'fe80::fc16:3eff:fe76:21b2', 'fe80::fc16:3eff:fef1:dbb2', 'fe80::fc16:3eff:fe15:2e88', 'fe80::607c:deff:fef1:6066', 'fe80::fc16:3eff:fe2e:c6a6', 'fe80::242c:71ff:fe9f:a235', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e', 'fe80::fc16:3eff:fe60:5adf', 'fe80::e454:63ff:fe15:5c57', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fefb:566a'] Jun 09 11:51:58.533163 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:51:58.533354 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:51:58.534321 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:58.535420 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Updating existing volume attachment record: f2e5630e-e0eb-4ea6-ba0a-9d137ad3056b {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:51:58.630817 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "refresh_cache-9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:58.630993 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquired lock "refresh_cache-9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:58.631152 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:58.768529 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:58.768650 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:58.768853 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:58.768959 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:58.769178 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:58.775772 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Terminating instance Jun 09 11:51:58.805857 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:58.809744 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 0552b995-0c80-4506-958f-14067c64e393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:58.831526 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:58.831526 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:58.831691 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] [instance: 0552b995-0c80-4506-958f-14067c64e393] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98325) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jun 09 11:51:58.887478 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:58.887478 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:51:58.887478 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:51:58.887478 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:58.887478 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:51:58.887725 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state rescued and task_state None. Jun 09 11:51:58.887751 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-changed-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:51:58.887886 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Refreshing instance network info cache due to event network-changed-49564634-0d84-4bee-ab08-85d73e85b82d. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:51:58.888048 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] Acquiring lock "refresh_cache-9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:58.915861 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Successfully created port: 16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 09 11:51:59.053870 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Found WWN 3300000008bedf4b3 for multipath device dm-8 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:51:59.054305 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:51:59.054550 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000008bedf4b3', 'path': '/dev/dm-8', 'multipath_id': '3300000008bedf4b3'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:51:59.054550 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008bedf4b3', 'path': '/dev/dm-8', 'multipath_id': '3300000008bedf4b3'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:51:59.058918 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:51:59.061976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f5112c5-cab8-4523-9994-d3b84e13b102', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:51:59.061976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:59.061976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:59.061976 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f5112c5-cab8-4523-9994-d3b84e13b102', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:51:59.076353 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:59.077067 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:59.077322 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:51:59.078066 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:51:59.078416 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:51:59.078563 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:51:59.092106 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:59.092106 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:59.097892 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:51:59.097892 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102] added Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:59.106574 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:59.107225 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:59.107225 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:59.107225 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102] added Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:51:59.109425 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:51:59.109682 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:51:59.109789 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:51:59.109915 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:51:59.229546 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Instance cache missing network info. {{(pid=98325) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 09 11:51:59.282531 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:51:59.321600 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for e1001828-c3fe-4a34-9f23-39d957daca78 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:51:59.321732 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:51:59.321769 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Resumed (Lifecycle Event) Jun 09 11:51:59.329748 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.337326 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.388566 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.402989 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.425294 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.435849 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.559870 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.573063 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1216793261',display_name='tempest-TestShelveInstance-server-1216793261',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testshelveinstance-server-1216793261',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-145988846',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:53Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4788b73b12d54f048721db84c2083cea',ramdisk_id='',reservation_id='r-4t16a4b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-256112623',owner_user_name='tempest-TestShelveInstance-256112623-project-member'},tags=,task_state='spawning',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:51:47Z,user_data=None,user_id='a22b8c3e8e0442dbb1610a6c4711f534',uuid=a1faf9d5-0b06-43ba-a171-aa1fa8337e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:51:59.573063 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converting VIF {"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:51:59.573381 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:51:59.578309 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'pci_devices' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:51:59.604292 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.652553 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.683468 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:51:59.716593 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.724878 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Unrescuing Jun 09 11:51:59.729197 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.729684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:51:59.729684 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:51:59.730885 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:51:59.789944 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Successfully updated port: 16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 09 11:51:59.795098 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.826455 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:51:59.837961 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:51:59.853110 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-9633500a-d540-4407-93d7-44ee0c65da04 tempest-ServerActionsTestOtherA-292149515 tempest-ServerActionsTestOtherA-292149515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.021s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:51:59.858309 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.887296 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:51:59.940367 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.050931 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 27d39b84-6464-471d-a472-d459193cba46] Instance destroyed successfully. Jun 09 11:52:00.050931 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lazy-loading 'resources' on Instance uuid 27d39b84-6464-471d-a472-d459193cba46 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:00.084354 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Object Instance lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] End _get_guest_xml xml= Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: instance-0000001b Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 196608 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: tempest-TestShelveInstance-server-1216793261 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 2026-06-09 11:51:55 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 192 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: True Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: ide Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: pc Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: tempest-TestShelveInstance-256112623-project-member Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: tempest-TestShelveInstance-256112623 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: a1faf9d5-0b06-43ba-a171-aa1fa8337e07 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: hvm Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 128 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: 2750a3aa-fc22-4517-880b-1707f8289e41 Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: Jun 09 11:52:00.084668 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Preparing to wait for external event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-09T11:50:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1216793261',display_name='tempest-TestShelveInstance-server-1216793261',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-testshelveinstance-server-1216793261',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-145988846',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:53Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4788b73b12d54f048721db84c2083cea',ramdisk_id='',reservation_id='r-4t16a4b3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-256112623',owner_user_name='tempest-TestShelveInstance-256112623-project-member'},tags=,task_state='spawning',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:51:47Z,user_data=None,user_id='a22b8c3e8e0442dbb1610a6c4711f534',uuid=a1faf9d5-0b06-43ba-a171-aa1fa8337e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converting VIF {"id": "f750843d-d81d-420f-a7f2-8cb43cccc274", "address": "fa:16:3e:0c:61:20", "network": {"id": "8342cded-ddaa-4218-9ca7-1b1a6a94be28", "bridge": "br-int", "label": "tempest-TestShelveInstance-921936547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4788b73b12d54f048721db84c2083cea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf750843d-d8", "ovs_interfaceid": "f750843d-d81d-420f-a7f2-8cb43cccc274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:52:00.091726 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.092375 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.092375 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:52:00.099289 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.099289 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dbd7d55-68ba-5673-929e-12a393aadfb4', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.099289 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.100710 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.110801 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:00.111198 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:00.149429 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:00.150809 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.164089 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.164348 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf750843d-d8, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.164753 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf750843d-d8, col_values=(('qos', UUID('21310c36-5c0c-4a4c-ac97-c800bad080ba')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.164966 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf750843d-d8, col_values=(('external_ids', {'iface-id': 'f750843d-d81d-420f-a7f2-8cb43cccc274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:61:20', 'vm-uuid': 'a1faf9d5-0b06-43ba-a171-aa1fa8337e07'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:00.168532 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.174974 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Updating instance_info_cache with network_info: [{"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:00.174974 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.177220 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.190194 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.203215 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:00.212999 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.219875 np0000002435 nova-compute[98325]: INFO os_vif [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:61:20,bridge_name='br-int',has_traffic_filtering=True,id=f750843d-d81d-420f-a7f2-8cb43cccc274,network=Network(8342cded-ddaa-4218-9ca7-1b1a6a94be28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf750843d-d8') Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.226200 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:00.245996 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:00.271376 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102, portal: 192.168.40.100,3260] Jun 09 11:52:00.271376 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102, portal: 192.168.40.100,3260] successful. Jun 09 11:52:00.271376 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.292591 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.294047 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:52:00.296628 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquired lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:00.296819 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Building network info cache for instance {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 09 11:52:00.306659 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102, portal: 192.168.50.100,3260] Jun 09 11:52:00.306659 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102, portal: 192.168.50.100,3260] successful. Jun 09 11:52:00.306659 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.326570 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.329878 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.253s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:00.330717 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:00.338921 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] HCTL ('20', '-', '-', 0) found on session 52 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:00.339403 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:00.343569 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 09 11:52:00.344820 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:00.344820 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Started (Lifecycle Event) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.362108 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.284s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:00.362796 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:00.366858 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] HCTL ('21', '-', '-', 0) found on session 53 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:00.366858 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:00.374224 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-765e8423-cb44-479e-ae12-1317cc140be6 req-1e671ec7-9329-4ab4-9f5f-5f52af99d97d service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:00.375761 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-765e8423-cb44-479e-ae12-1317cc140be6 req-1e671ec7-9329-4ab4-9f5f-5f52af99d97d service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:00.376169 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-765e8423-cb44-479e-ae12-1317cc140be6 req-1e671ec7-9329-4ab4-9f5f-5f52af99d97d service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:00.376725 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-765e8423-cb44-479e-ae12-1317cc140be6 req-1e671ec7-9329-4ab4-9f5f-5f52af99d97d service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:00.376791 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-765e8423-cb44-479e-ae12-1317cc140be6 req-1e671ec7-9329-4ab4-9f5f-5f52af99d97d service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:00.377088 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-765e8423-cb44-479e-ae12-1317cc140be6 req-1e671ec7-9329-4ab4-9f5f-5f52af99d97d service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:00.386481 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Searching for a device in session 52 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:00.386668 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f5112c5-cab8-4523-9994-d3b84e13b102', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:00.394343 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Searching for a device in session 53 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:00.394343 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f5112c5-cab8-4523-9994-d3b84e13b102', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:00.454528 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.555785 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:00.556744 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "address": "fa:16:3e:f5:a8:4b", "network": {"id": "dd37ac3f-d975-4e50-bab6-682e36add705", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-353305997-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5b2c30-99", "ovs_interfaceid": "db5b2c30-999a-4205-a9e3-0e05c15b24f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.556744 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.557163 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:00.558035 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.559314 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb5b2c30-99, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.560539 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.561485 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.633433 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.640601 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.641212 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a3a6abf-e546-4509-a7dc-e44d14613989) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.642680 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.642680 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.675673 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Releasing lock "refresh_cache-9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:00.676021 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Instance network_info: |[{"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98325) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 09 11:52:00.676531 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] Acquired lock "refresh_cache-9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:00.676669 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Refreshing network info cache for port 49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:52:00.692422 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.695899 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=db5b2c30-999a-4205-a9e3-0e05c15b24f3,network=Network(dd37ac3f-d975-4e50-bab6-682e36add705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5b2c30-99') Jun 09 11:52:00.697042 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:00.697042 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "address": "fa:16:3e:f1:20:ea", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41e87f6a-f7", "ovs_interfaceid": "41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.697372 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.697619 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:00.698759 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.699090 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41e87f6a-f7, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.702760 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.724058 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Start spawning the instance on the hypervisor. {{(pid=98325) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 09 11:52:00.726137 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Creating instance directory {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5231}} Jun 09 11:52:00.727504 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Creating image(s) Jun 09 11:52:00.727999 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Did not create local disks {{(pid=98325) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5375}} Jun 09 11:52:00.728190 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Ensure instance console log exists: /opt/stack/data/nova/instances/9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60/console.log {{(pid=98325) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5110}} Jun 09 11:52:00.729821 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:00.730041 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:00.730449 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:00.731082 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Start _get_guest_xml network_info=[{"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60', 'attached_at': '', 'detached_at': '', 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'serial': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'multiattach': True}, 'attachment_id': 'f2e5630e-e0eb-4ea6-ba0a-9d137ad3056b', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8218}} Jun 09 11:52:00.742554 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.745330 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.745584 np0000002435 nova-compute[98325]: WARNING nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 09 11:52:00.747099 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1682598696', uuid='9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60'), owner=OwnerMeta(userid='8d422c8cd17d4fe5b548032f10c7c80f', username='tempest-AttachVolumeMultiAttachTest-938991733-project-member', projectid='9e3020791dcd4ef4b7980dd196a8ca96', projectname='tempest-AttachVolumeMultiAttachTest-938991733'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005920.7466087) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:52:00.749143 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b1a3545-c830-4037-b7d4-a30b2970cc1c) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.749607 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V1... {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 09 11:52:00.750201 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller missing on host. {{(pid=98325) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 09 11:52:00.751796 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching host: 'np0000002435' for CPU controller through CGroups V2... {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 09 11:52:00.751796 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU controller found on host. {{(pid=98325) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 09 11:52:00.753563 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98325) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5912}} Jun 09 11:52:00.754415 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.754601 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-09T11:44:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 09 11:52:00.754847 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 09 11:52:00.755365 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image limits 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 09 11:52:00.755565 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flavor pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 09 11:52:00.755715 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Image pref 0:0:0 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 09 11:52:00.757275 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98325) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 09 11:52:00.757275 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 09 11:52:00.757275 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 09 11:52:00.757275 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got 1 possible topologies {{(pid=98325) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 09 11:52:00.757275 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 09 11:52:00.757275 np0000002435 nova-compute[98325]: DEBUG nova.virt.hardware [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98325) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 09 11:52:00.770322 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.777516 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:52:00.777516 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:00.777516 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:00.791169 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.794392 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:ea,bridge_name='br-int',has_traffic_filtering=True,id=41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41e87f6a-f7') Jun 09 11:52:00.796562 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:00.796782 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "address": "fa:16:3e:5d:9d:27", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0f3fbb-f8", "ovs_interfaceid": "5f0f3fbb-f84a-4eaa-9560-e874bfac6980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.801711 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.803003 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:00.808562 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.808666 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f0f3fbb-f8, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.810686 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.812104 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.840137 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.841506 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.841674 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad3abfca-219a-4d7a-97d3-bde2acc4c768) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.843566 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.846608 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:00.846960 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:00.847101 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:00.847214 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:00.847359 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:00.847521 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-dd09698b-8819-4223-ba54-5997b963a450 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:00.847733 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-changed-16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:00.847791 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Refreshing instance network info cache due to event network-changed-16900a18-8e91-4ab1-bf5c-d487aac54f6b. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:52:00.848590 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Acquiring lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:52:00.849821 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:00.855232 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:52:00.870133 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.873089 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:9d:27,bridge_name='br-int',has_traffic_filtering=True,id=5f0f3fbb-f84a-4eaa-9560-e874bfac6980,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f0f3fbb-f8') Jun 09 11:52:00.873894 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:00.874117 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "dd09698b-8819-4223-ba54-5997b963a450", "address": "fa:16:3e:76:21:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd09698b-88", "ovs_interfaceid": "dd09698b-8819-4223-ba54-5997b963a450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.875064 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.875316 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:00.877627 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.879393 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd09698b-88, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.885396 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.907309 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.908686 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.908895 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eee507bd-3809-4a6c-8d36-ba11cd6854ac) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.909756 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.910443 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.933410 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.935574 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:21:b2,bridge_name='br-int',has_traffic_filtering=True,id=dd09698b-8819-4223-ba54-5997b963a450,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd09698b-88') Jun 09 11:52:00.940354 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:00.940354 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "address": "fa:16:3e:f1:db:b2", "network": {"id": "20a426b5-1317-4d57-82d4-930fd355f3b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-288693485", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb0c616-4a", "ovs_interfaceid": "6cb0c616-4a6d-43a3-be75-4a37d5e762ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.941316 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.941316 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:00.945499 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.945499 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cb0c616-4a, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.950175 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.964622 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.966594 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.968201 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7ff9784-da32-4021-92d1-844cc8406464) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:00.970711 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.970711 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:00.992015 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:00.996965 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:db:b2,bridge_name='br-int',has_traffic_filtering=True,id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee,network=Network(20a426b5-1317-4d57-82d4-930fd355f3b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb0c616-4a') Jun 09 11:52:00.997872 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:00.998111 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "972fd9d4-c41e-4586-a696-46db1e2103d1", "address": "fa:16:3e:15:2e:88", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap972fd9d4-c4", "ovs_interfaceid": "972fd9d4-c41e-4586-a696-46db1e2103d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:00.998836 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:00.999129 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:01.005090 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.005090 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap972fd9d4-c4, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:01.009035 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.009035 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:01.018794 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.021113 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.021489 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af74e8f8-e6c3-4d23-9edf-ef4c6d3b66d5) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:01.022801 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.022801 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:01.027313 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:01.034904 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.038151 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:2e:88,bridge_name='br-int',has_traffic_filtering=True,id=972fd9d4-c41e-4586-a696-46db1e2103d1,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap972fd9d4-c4') Jun 09 11:52:01.039746 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-143407640',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-143407640',id=24,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsnaE4Vc8fEOlnhmRDiR0Awfy7/8otGI/zVgT+QjUiOkqyPvWjvVaHUq+RBiVI0K3hVKqKD1TpdPf4jiiqUcWy5G/M7YBCki8A86WGmYvSWIsuO/5tNOzjWhfsUk8rcFg==',key_name='tempest-keypair-515973017',keypairs=,launch_index=0,launched_at=2026-06-09T11:50:49Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='d28334e5ba844783948826494406371f',ramdisk_id='',reservation_id='r-ssdtzsjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1697688058',owner_user_name='tempest-TaggedBootDevicesTest-1697688058-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e12766d5909543f6a81aa3b99c467d7c',uuid=27d39b84-6464-471d-a472-d459193cba46,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:01.039746 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converting VIF {"id": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "address": "fa:16:3e:2e:c6:a6", "network": {"id": "86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30", "bridge": "br-int", "label": "tempest-device-tagging-net2-960142474", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d28334e5ba844783948826494406371f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef25b9f-6e", "ovs_interfaceid": "9ef25b9f-6e2e-4716-986b-bac1f4bf61ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:01.041060 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:01.043557 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:01.044747 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.046134 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ef25b9f-6e, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:01.047730 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.047730 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:01.056592 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.057803 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.059346 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7744fd0f-0cfd-449f-ac33-f4a0be485273) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:01.060650 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:01.067593 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:01.069595 np0000002435 nova-compute[98325]: INFO os_vif [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c6:a6,bridge_name='br-int',has_traffic_filtering=True,id=9ef25b9f-6e2e-4716-986b-bac1f4bf61ab,network=Network(86a9905e-6d6c-44f0-ac8a-77b0e8c6ea30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef25b9f-6e') Jun 09 11:52:01.071715 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:52:01.071715 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:01.071715 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:01.080254 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:52:01.183157 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:01.208978 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:01.211629 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:01.211629 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:01.212735 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:01.213017 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:01.213017 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-db5b2c30-999a-4205-a9e3-0e05c15b24f3 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:01.213152 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:01.213321 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:01.213484 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:01.213611 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:01.213743 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:01.213877 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:01.214020 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:01.214168 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:01.216580 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:01.219043 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:01.219274 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:01.220523 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3014881b-7ccc-4115-bb4c-ff0940846f0e req-088ca183-803a-4bd8-a625-19bd8a98181a service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-5f0f3fbb-f84a-4eaa-9560-e874bfac6980 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:01.236972 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:01.270359 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:01.359553 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 09 11:52:01.359553 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99974213700034 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:01.642679 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:01.680194 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:01.738760 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:01.739366 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'flavor' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:01.747967 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:01.748160 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:01.751652 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] No VIF found with MAC fa:16:3e:0c:61:20, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:52:01.752602 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Using config drive Jun 09 11:52:01.844003 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Updated VIF entry in instance network info cache for port 49564634-0d84-4bee-ab08-85d73e85b82d. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:52:01.844434 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Updating instance_info_cache with network_info: [{"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:01.885206 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updating instance_info_cache with network_info: [{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:02.100828 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Found WWN 3300000006c9725fc for multipath device dm-12 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:52:02.101201 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:02.101408 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000006c9725fc', 'path': '/dev/dm-12', 'multipath_id': '3300000006c9725fc'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:02.101557 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006c9725fc', 'path': '/dev/dm-12', 'multipath_id': '3300000006c9725fc'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:52:02.102950 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.325s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:02.102950 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:52:02.105101 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lazy-loading 'flavor' on Instance uuid 53197df6-c8eb-4a07-8ee4-50146c8cd972 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:02.117039 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:02.117551 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:02.117782 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:02.118483 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:02.120331 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:02.120331 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:02.133542 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:52:02.133542 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:02.143580 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:52:02.143580 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498] added Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:52:02.151152 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498] added Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:02.158190 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:02.158713 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:52:02.158713 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:52:02.158713 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:52:02.262271 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'ec2_ids' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:02.276897 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.288597 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.319296 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.349726 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-698d6521-9f5c-41cc-976b-ff491afd34fb req-264ca7aa-8ee4-4fe7-a7e6-e8a1d3b58ee3 service nova] Releasing lock "refresh_cache-9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:02.388406 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Releasing lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:02.389387 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Acquired lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:02.389387 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Refreshing network info cache for port 16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:52:02.391910 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-742532993',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-742532993',id=29,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA35vEM+6OqXDR0JQG4cDBPDgdOrApIAreJCofMDPlXPp8kKchDPHqKG43+TSrj8dFvcp5aC9yvxAm4zT2dr4Bw2BlsISQwapJ7RuYZFUaN8iJ7TcZLuewNCfpyXuWqeA==',key_name='tempest-keypair-1101382972',keypairs=,launch_index=0,launched_at=2026-06-09T11:51:17Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba3c8b095803407d840bba1d5011fe4d',ramdisk_id='',reservation_id='r-0xaphmq4',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1193400979',owner_user_name='tempest-TaggedAttachmentsTest-1193400979-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8a42aa4ff1541129a17ab41caff8de1',uuid=9971a9c4-4000-45ee-90b3-88855b1e9c9c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:52:02.392178 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converting VIF {"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:02.394393 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:52,bridge_name='br-int',has_traffic_filtering=True,id=16900a18-8e91-4ab1-bf5c-d487aac54f6b,network=Network(4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16900a18-8e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:02.394393 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:52,bridge_name='br-int',has_traffic_filtering=True,id=16900a18-8e91-4ab1-bf5c-d487aac54f6b,network=Network(4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16900a18-8e') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:52:02.394682 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.394813 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:02.395060 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:52:02.397546 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.398504 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38e2f8fb-cec6-565b-8631-f4a40cb82b3f', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:02.401797 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.402523 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:02.413723 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.417703 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.417978 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16900a18-8e, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:02.418368 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16900a18-8e, col_values=(('qos', UUID('0694ce66-272a-492b-a516-100201f75385')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:02.418545 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16900a18-8e, col_values=(('external_ids', {'iface-id': '16900a18-8e91-4ab1-bf5c-d487aac54f6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:b4:52', 'vm-uuid': '9971a9c4-4000-45ee-90b3-88855b1e9c9c'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:02.420003 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.422774 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:02.438363 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.439514 np0000002435 nova-compute[98325]: INFO os_vif [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:52,bridge_name='br-int',has_traffic_filtering=True,id=16900a18-8e91-4ab1-bf5c-d487aac54f6b,network=Network(4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16900a18-8e') Jun 09 11:52:02.440876 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-742532993',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-742532993',id=29,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA35vEM+6OqXDR0JQG4cDBPDgdOrApIAreJCofMDPlXPp8kKchDPHqKG43+TSrj8dFvcp5aC9yvxAm4zT2dr4Bw2BlsISQwapJ7RuYZFUaN8iJ7TcZLuewNCfpyXuWqeA==',key_name='tempest-keypair-1101382972',keypairs=,launch_index=0,launched_at=2026-06-09T11:51:17Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba3c8b095803407d840bba1d5011fe4d',ramdisk_id='',reservation_id='r-0xaphmq4',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1193400979',owner_user_name='tempest-TaggedAttachmentsTest-1193400979-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8a42aa4ff1541129a17ab41caff8de1',uuid=9971a9c4-4000-45ee-90b3-88855b1e9c9c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:52:02.440876 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converting VIF {"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:02.441178 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b4:52,bridge_name='br-int',has_traffic_filtering=True,id=16900a18-8e91-4ab1-bf5c-d487aac54f6b,network=Network(4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16900a18-8e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] attach device xml: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: Jun 09 11:52:02.443172 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:52:02.476983 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.493803 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.495634 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.496521 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.496521 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.496706 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.496874 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-41e87f6a-f7ac-48d8-bb62-f549a4f5e3ea for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.497061 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.497207 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.497631 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.498127 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.498297 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.498458 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.498597 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.498774 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.498959 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.499113 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.499282 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.499428 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-6cb0c616-4a6d-43a3-be75-4a37d5e762ee for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.499562 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.499728 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.499873 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.500019 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.500151 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.500308 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-972fd9d4-c41e-4586-a696-46db1e2103d1 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.500452 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.500596 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.500826 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.500964 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.501092 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.501224 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-53b40080-9190-4c00-976c-01c346f4f0fe req-c3a15657-9f96-48d4-a9d0-7287e26246c5 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-972fd9d4-c41e-4586-a696-46db1e2103d1 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.505014 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.592392 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.599982 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:02.612989 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Attempting to attach volume 9f5112c5-cab8-4523-9994-d3b84e13b102 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] attach device xml: Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: 9f5112c5-cab8-4523-9994-d3b84e13b102 Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: Jun 09 11:52:02.615175 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:52:02.768127 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Object Instance lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:52:02.768127 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lazy-loading 'keypairs' on Instance uuid a1faf9d5-0b06-43ba-a171-aa1fa8337e07 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:02.882090 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.99966681800015 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:02.884530 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Instance destroyed successfully. Jun 09 11:52:02.886503 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Lazy-loading 'numa_topology' on Instance uuid e1001828-c3fe-4a34-9f23-39d957daca78 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:02.892153 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:02.969654 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.969654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.969654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.969654 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.970288 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.970638 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.970829 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.971591 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.971643 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.971823 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.971982 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.972191 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:02.972366 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-vif-plugged-16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:02.972525 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:02.972675 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:02.973150 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:02.973150 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] No waiting events found dispatching network-vif-plugged-16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:02.973150 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-dabeab52-ea31-4e8e-a202-272a0fb2500a req-0df71f2b-7857-4c1e-b4eb-fda3747df45f service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received unexpected event network-vif-plugged-16900a18-8e91-4ab1-bf5c-d487aac54f6b for instance with vm_state active and task_state None. Jun 09 11:52:03.009772 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:03.025781 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:03.032304 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:03.063679 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:03.075814 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:03.151753 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:03.162011 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:03.173713 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:03.189589 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.198050 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.210387 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.233169 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.233735 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.247907 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.248413 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:03.273290 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Object Instance lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:52:03.279822 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:03.312757 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.50.100,3260] Jun 09 11:52:03.312757 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.50.100,3260] successful. Jun 09 11:52:03.312757 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.324491 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:03.327627 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.40.100,3260] Jun 09 11:52:03.327627 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.40.100,3260] successful. Jun 09 11:52:03.327627 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.334742 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.348288 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:03.364385 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:03.366448 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('23', '-', '-', 0) found on session 54 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:03.366448 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.377116 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.260s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:03.378755 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:03.379916 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] HCTL ('24', '-', '-', 0) found on session 55 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:03.380028 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:03.393839 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 54 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:03.394174 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:03.394616 np0000002435 nova-compute[98325]: DEBUG nova.objects.base [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98325) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 09 11:52:03.421359 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:03.421359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:03.422981 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:03.422981 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:03.422981 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:03.423534 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state rescued and task_state unrescuing. Jun 09 11:52:03.423534 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:03.425080 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:03.425080 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:03.428203 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:03.428330 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:03.428508 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-3594d1f9-c883-4a26-a17a-55cbba2dacbf req-ddb9d3bb-d443-4527-bba3-e8ecc606087f service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-unplugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state rescued and task_state unrescuing. Jun 09 11:52:03.430693 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Searching for a device in session 55 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:03.430847 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:03.483794 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Creating config drive at /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/disk.config Jun 09 11:52:03.488340 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7jeldsk0 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:52:03.557931 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a1faf9d5-0b06-43ba-a171-aa1fa8337e07/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7jeldsk0" returned: 0 in 0.067s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:52:03.583172 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updated VIF entry in instance network info cache for port 16900a18-8e91-4ab1-bf5c-d487aac54f6b. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:52:03.583697 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updating instance_info_cache with network_info: [{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:04.086509 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Releasing lock "refresh_cache-9971a9c4-4000-45ee-90b3-88855b1e9c9c" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:04.087126 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:04.087126 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Acquiring lock "27d39b84-6464-471d-a472-d459193cba46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:04.087342 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:04.087480 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] Lock "27d39b84-6464-471d-a472-d459193cba46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:04.087618 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] No waiting events found dispatching network-vif-unplugged-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:04.087751 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-4e854233-1852-4c67-881c-35b15fe66a6b req-e461e2ae-5ea0-4de3-90cb-ca1e7e834db4 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-unplugged-dd09698b-8819-4223-ba54-5997b963a450 for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:04.120202 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:52:04.174053 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:04.174222 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:04.174222 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No VIF found with MAC fa:16:3e:98:9a:c9, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:52:04.250439 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010889079999287787 future=) was cancelled during its delay period, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:04.250558 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:04.250733 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.108428910000384 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:04.250813 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.108324408000044 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:04.251379 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.285126 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.290213 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.358317 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.384744 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.388009 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.413601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:04.413601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:04.413601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:04.413601 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] No VIF found with MAC fa:16:3e:60:5a:df, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:52:04.451536 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.453620 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.464448 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.591419 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.683979 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-742532993', uuid='9971a9c4-4000-45ee-90b3-88855b1e9c9c'), owner=OwnerMeta(userid='f8a42aa4ff1541129a17ab41caff8de1', username='tempest-TaggedAttachmentsTest-1193400979-project-member', projectid='ba3c8b095803407d840bba1d5011fe4d', projectname='tempest-TaggedAttachmentsTest-1193400979'), image=ImageMeta(id='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "address": "fa:16:3e:98:9a:c9", "network": {"id": "e9662547-c501-4617-8b73-4b4517ef0889", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-20460973-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c65da-c6", "ovs_interfaceid": "068c65da-c6ae-4431-8cc8-34b8b24f6f4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1781005924.6832306) {{(pid=98325) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] set metadata xml: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: tempest-device-tagging-server-742532993 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 2026-06-09 11:52:04 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 192 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: True Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: bare Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: ide Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: pc Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: tempest-TaggedAttachmentsTest-1193400979-project-member Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: tempest-TaggedAttachmentsTest-1193400979 Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: Jun 09 11:52:04.685306 np0000002435 nova-compute[98325]: {{(pid=98325) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jun 09 11:52:04.869997 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:04.902847 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:05.071488 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received event network-vif-plugged-16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:05.071488 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:05.071488 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:05.071488 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.071865 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] No waiting events found dispatching network-vif-plugged-16900a18-8e91-4ab1-bf5c-d487aac54f6b {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:05.072099 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Received unexpected event network-vif-plugged-16900a18-8e91-4ab1-bf5c-d487aac54f6b for instance with vm_state active and task_state None. Jun 09 11:52:05.072172 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:05.072374 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:05.072540 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:05.072703 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.072859 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Processing event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:52:05.073084 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:05.073214 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Acquiring lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:05.073400 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:05.073595 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.073710 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] No waiting events found dispatching network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:05.073869 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-f56b8cce-2255-4e1f-9382-1fdf5861e45a req-26c90d92-b34b-45d7-bda0-8505d57646e3 service nova] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Received unexpected event network-vif-plugged-f750843d-d81d-420f-a7f2-8cb43cccc274 for instance with vm_state shelved_offloaded and task_state spawning. Jun 09 11:52:05.141343 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Found WWN 3300000004b136900 for multipath device dm-14 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:52:05.141343 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:05.141832 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== connect_volume: return (4363ms) {'type': 'block', 'scsi_wwn': '3300000004b136900', 'path': '/dev/dm-14', 'multipath_id': '3300000004b136900'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:05.141832 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004b136900', 'path': '/dev/dm-14', 'multipath_id': '3300000004b136900'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:52:05.142187 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.070s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:05.142668 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc00fe60-f81d-4db8-b0ff-48fe626f166a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:52:05.143347 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '55')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:52:05.182132 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '34')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:05.185893 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a', '33')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:05.185893 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Resulting device map defaultdict(. at 0x77d8e03f5c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'): ({'sdd'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:52:05.185893 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Removing multipathed devices sdd, sde {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:52:05.185893 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Flush multipath device 330000000881cc3d4 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:52:05.201038 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-4563f957-f654-4853-b5a8-776fde118bfc tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "interface-9971a9c4-4000-45ee-90b3-88855b1e9c9c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 8.266s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.241814 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:05.295033 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:05.346734 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:52:05.346734 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:52:05.346734 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:52:05.359868 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:52:05.359868 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:52:05.372563 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.420365 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.40.100,3260] Jun 09 11:52:05.420365 np0000002435 nova-compute[98325]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.40.100,3260] successful. Jun 09 11:52:05.420365 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.427789 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:52:05.428909 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.host [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Removed pending STOPPED event for e1001828-c3fe-4a34-9f23-39d957daca78 due to new event Resumed> {{(pid=98325) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 09 11:52:05.429103 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:05.429246 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Resumed (Lifecycle Event) Jun 09 11:52:05.431744 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:52:05.437350 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-900ea926-64e6-471f-97cd-d98fc70d4373 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:05.446591 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Instance spawned successfully. Jun 09 11:52:05.447756 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:05.455438 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.459981 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:05.469103 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.512216 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.50.100,3260] Jun 09 11:52:05.512216 np0000002435 nova-compute[98325]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-dc00fe60-f81d-4db8-b0ff-48fe626f166a, portal: 192.168.50.100,3260] successful. Jun 09 11:52:05.512216 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.520024 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:05.520523 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:05.520733 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:05.520918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.521075 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:05.521230 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state active and task_state None. Jun 09 11:52:05.521428 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:05.521573 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] Acquiring lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:05.521874 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:05.521874 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] Lock "e1001828-c3fe-4a34-9f23-39d957daca78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.522093 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] No waiting events found dispatching network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:05.522179 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-c2bb06d0-52ab-4e48-a0ce-da0f1111ea45 req-ee7e5c31-d727-4d0e-a691-ee6254681ad3 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received unexpected event network-vif-plugged-feddf54e-5a7b-4bff-9c76-c0540ef05ffb for instance with vm_state active and task_state None. Jun 09 11:52:05.543088 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.543088 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:05.543088 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== disconnect_volume: return (4470ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:05.543088 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:52:05.547982 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:52:05.547982 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:05.547982 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:05.547982 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:05.547982 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cccb28ff-e435-4216-b524-2a6ba0a79bdc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:52:05.547982 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '55')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '35')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:05.593289 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc', '36')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:05.594222 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Resulting device map defaultdict(. at 0x77d8e0512660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'): ({'sdg'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:52:05.594548 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Removing multipathed devices sdg, sdf {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:52:05.594874 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Flush multipath device 3300000009caf747f {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:52:05.632446 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:05.649210 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1682598696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachvolumemultiattachtest-server-1682598696',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-0lp89spn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:58Z,user_data=None,user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:52:05.650178 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:05.651542 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:05.652665 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:05.689102 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:05.731002 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:52:05.731002 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:52:05.733803 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:52:05.748116 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:52:05.748575 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:52:05.763941 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.820637 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.40.100,3260] Jun 09 11:52:05.820637 np0000002435 nova-compute[98325]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.40.100,3260] successful. Jun 09 11:52:05.820637 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.850200 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.866179 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.912499 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.50.100,3260] Jun 09 11:52:05.912499 np0000002435 nova-compute[98325]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-cccb28ff-e435-4216-b524-2a6ba0a79bdc, portal: 192.168.50.100,3260] successful. Jun 09 11:52:05.912499 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.936079 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:05.938705 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:52:05.942287 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:05.942580 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:05.942772 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== disconnect_volume: return (395ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:05.943330 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:52:05.944974 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:52:05.944974 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:05.944974 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:05.945573 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:05.948157 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e5233d9-a5c9-4a9f-844c-c459559cd348', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:52:05.949076 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:52:05.962249 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-ddd88c15-eaa7-4779-a7a8-c3eadf3de45f tempest-TestShelveInstance-256112623 tempest-TestShelveInstance-256112623-project-member] Lock "a1faf9d5-0b06-43ba-a171-aa1fa8337e07" "released" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: held 19.405s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '55')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '39')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:05.997316 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348', '40')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:06.001157 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Resulting device map defaultdict(. at 0x77d8e076cfe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'): ({'sdm'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:52:06.002111 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Removing multipathed devices sdm, sdl {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:52:06.004345 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Flush multipath device 33000000041759b88 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:52:06.007039 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-13d27f79-87a4-470e-b1d6-90a3140c2919 tempest-TestMinimumBasicScenario-1698382388 tempest-TestMinimumBasicScenario-1698382388-project-member] Lock "53197df6-c8eb-4a07-8ee4-50146c8cd972" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.728s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:06.047204 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:06.083042 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:06.132357 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:52:06.132357 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:52:06.133781 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:52:06.152679 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:52:06.153134 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] End _get_guest_xml xml= Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: instance-00000020 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 196608 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-server-1682598696 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 2026-06-09 11:52:00 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 192 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: True Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733-project-member Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: tempest-AttachVolumeMultiAttachTest-938991733 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: hvm Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 128 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: 6722d98e-c3b5-40cd-8530-1e77e1d65498 Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: /dev/urandom Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: {{(pid=98325) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8225}} Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Preparing to wait for external event network-vif-plugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:06.160316 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-09T11:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1682598696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachvolumemultiattachtest-server-1682598696',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-0lp89spn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-09T11:51:58Z,user_data=None,user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 09 11:52:06.165348 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:06.165348 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:06.165348 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') {{(pid=98325) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 09 11:52:06.165348 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.165348 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:06.165348 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 09 11:52:06.168215 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.168510 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00a03771-61e0-506d-9157-6cb4249f6d48', '_type': 'linux-noop'}}, row=False) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:06.169465 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.171601 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:06.173238 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:06.175481 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.179304 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.179606 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49564634-0d, may_exist=True, interface_attrs={}) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:06.180077 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49564634-0d, col_values=(('qos', UUID('17dbe722-06c2-4d7c-89e0-5898f2a86242')),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:06.180294 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49564634-0d, col_values=(('external_ids', {'iface-id': '49564634-0d84-4bee-ab08-85d73e85b82d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d6:ac', 'vm-uuid': '9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60'}),), if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:06.181430 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.184751 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:06.190289 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:06.191748 np0000002435 nova-compute[98325]: INFO os_vif [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') Jun 09 11:52:06.223603 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.40.100,3260] Jun 09 11:52:06.223603 np0000002435 nova-compute[98325]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.40.100,3260] successful. Jun 09 11:52:06.223603 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:06.248519 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:06.255457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:06.255457 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:06.265480 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:06.308934 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.50.100,3260] Jun 09 11:52:06.308934 np0000002435 nova-compute[98325]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-7e5233d9-a5c9-4a9f-844c-c459559cd348, portal: 192.168.50.100,3260] successful. Jun 09 11:52:06.308934 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:06.349000 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:06.349000 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:06.349000 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] <== disconnect_volume: return (402ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:06.349000 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:52:06.349000 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Deleting instance files /opt/stack/data/nova/instances/27d39b84-6464-471d-a472-d459193cba46_del Jun 09 11:52:06.349000 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Deletion of /opt/stack/data/nova/instances/27d39b84-6464-471d-a472-d459193cba46_del complete Jun 09 11:52:06.443609 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:06.443609 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Started (Lifecycle Event) Jun 09 11:52:06.761357 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'flavor' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:06.865236 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Took 7.58 seconds to destroy the instance on the hypervisor. Jun 09 11:52:06.867720 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:52:06.868822 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 27d39b84-6464-471d-a472-d459193cba46] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:52:06.868822 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 27d39b84-6464-471d-a472-d459193cba46] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:52:06.871851 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:06.946541 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:06.952523 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:52:07.181885 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:07.331789 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:07.332828 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing instance network info cache due to event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:52:07.332828 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:52:07.332828 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:07.332828 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:52:07.456462 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:07.456462 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Paused (Lifecycle Event) Jun 09 11:52:07.717329 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:07.717329 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:07.717329 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] No VIF found with MAC fa:16:3e:ad:d6:ac, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:52:07.718572 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Using config drive Jun 09 11:52:07.775212 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.519s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:07.838235 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:07.882846 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:07.882846 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:07.963347 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:07.965579 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:07.965846 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] VM Started (Lifecycle Event) Jun 09 11:52:08.226341 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:08.364918 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:08.387586 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lazy-loading 'flavor' on Instance uuid ce77fb0b-4e58-4031-83b7-9fcef9a731f1 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:08.469304 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:08.476178 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:52:08.500597 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Creating config drive at /opt/stack/data/nova/instances/9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60/disk.config Jun 09 11:52:08.504641 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaes5vla6 {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:52:08.565669 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaes5vla6" returned: 0 in 0.060s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:52:08.680300 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updated VIF entry in instance network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:52:08.680300 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:08.897116 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Ignoring supplied device name: /dev/vdb Jun 09 11:52:08.901983 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:08.902280 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:08.902619 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Attaching volume c23e4e27-749e-438b-bf5d-b112c7d335a6 to /dev/vdb Jun 09 11:52:08.968581 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:08.981999 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:08.981999 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] VM Resumed (Lifecycle Event) Jun 09 11:52:09.002032 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:52:09.028303 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:52:09.086050 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9bcf07e4-3945-47e2-a1e2-e3edec2d3500 req-281efded-5b1e-49da-93ef-ee7f21f1f69b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-deleted-6cb0c616-4a6d-43a3-be75-4a37d5e762ee {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:09.086664 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-9bcf07e4-3945-47e2-a1e2-e3edec2d3500 req-281efded-5b1e-49da-93ef-ee7f21f1f69b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Neutron deleted interface 6cb0c616-4a6d-43a3-be75-4a37d5e762ee; detaching it from the instance and deleting it from the info cache Jun 09 11:52:09.087759 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:52:09.088035 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:52:09.093033 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-9bcf07e4-3945-47e2-a1e2-e3edec2d3500 req-281efded-5b1e-49da-93ef-ee7f21f1f69b service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Detach interface failed, port_id=6cb0c616-4a6d-43a3-be75-4a37d5e762ee, reason: Instance 27d39b84-6464-471d-a472-d459193cba46 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:52:09.100819 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:52:09.103917 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e', 'fe80::fc16:3eff:fe60:5adf', 'fe80::e454:63ff:fe15:5c57', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fedb:b452', 'fe80::c01e:b0ff:fe97:5d70', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe0c:6120', 'fe80::682d:3aff:fe51:290b'] Jun 09 11:52:09.104199 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:52:09.105164 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:52:09.105164 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:09.105164 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Updating existing volume attachment record: 1f3a2fe6-4b16-4f35-9a09-a5a40cbb18a6 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:52:09.181978 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-d0f5f9bb-8cb0-4602-99cc-2138db7ed100 req-436deec8-e7c3-4e81-9c09-4e0edddc7646 service nova] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:09.220491 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:09.251818 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:09.254310 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:09.366134 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:09.400392 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:09.431875 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:09.435371 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:09.448918 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Received event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:09.448918 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing instance network info cache due to event network-changed-feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:52:09.448918 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] Acquiring lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:52:09.450095 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] Acquired lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:09.450095 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Refreshing network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:52:09.491303 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:09.494481 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: a1faf9d5-0b06-43ba-a171-aa1fa8337e07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:52:09.679556 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:52:09.680007 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c23e4e27-749e-438b-bf5d-b112c7d335a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:09.680201 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:09.680689 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:09.680974 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c23e4e27-749e-438b-bf5d-b112c7d335a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:52:09.700816 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:09.700816 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:09.701253 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:09.702907 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:09.703699 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:09.704000 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:09.717128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:52:09.717128 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:09.727921 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:52:09.727921 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6] added Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:09.736523 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:09.738042 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:52:09.738042 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:52:09.738042 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6] added Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0429(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:52:09.747006 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:52:09.876016 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-49289d0d-e1f3-46bf-8aee-104410deea24 req-d40788ac-b80f-48b6-9ac7-07667029b728 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-deleted-dd09698b-8819-4223-ba54-5997b963a450 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:09.876016 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-49289d0d-e1f3-46bf-8aee-104410deea24 req-d40788ac-b80f-48b6-9ac7-07667029b728 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Neutron deleted interface dd09698b-8819-4223-ba54-5997b963a450; detaching it from the instance and deleting it from the info cache Jun 09 11:52:09.880043 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-49289d0d-e1f3-46bf-8aee-104410deea24 req-d40788ac-b80f-48b6-9ac7-07667029b728 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Detach interface failed, port_id=dd09698b-8819-4223-ba54-5997b963a450, reason: Instance 27d39b84-6464-471d-a472-d459193cba46 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:52:09.956082 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:10.345747 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Started> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:10.346211 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] VM Started (Lifecycle Event) Jun 09 11:52:10.425123 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:10.465005 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:10.509192 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:10.509456 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:10.509690 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Attaching volume fa0e83ab-0d3c-4c39-8297-4c39fee57a7f to /dev/vdb Jun 09 11:52:10.577223 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.214', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002435', 'execute': None}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:10.593542 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.scaleio [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98325) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 09 11:52:10.626752 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Running cmd (subprocess): nvme version {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:52:10.648152 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updated VIF entry in instance network info cache for port feddf54e-5a7b-4bff-9c76-c0540ef05ffb. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:52:10.651353 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: e1001828-c3fe-4a34-9f23-39d957daca78] Updating instance_info_cache with network_info: [{"id": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "address": "fa:16:3e:fb:56:6a", "network": {"id": "432e678d-fb3b-4bae-aa53-05be91cebcfd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1857830337-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8357a877b64741ce827b8108c288a358", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeddf54e-5a", "ovs_interfaceid": "feddf54e-5a7b-4bff-9c76-c0540ef05ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:10.684091 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] 'nvme version' failed. Not Retrying. {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 09 11:52:10.685832 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.nvmeof [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] nvme not present on system {{(pid=98325) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 09 11:52:10.705185 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98325) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 09 11:52:10.705185 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.lightos [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Current host hostNQN and IP(s) are ['10.4.3.214', 'fe80::f816:3eff:fe7d:da51', '192.168.40.6', 'fe80::f816:3eff:fe0f:9738', '192.168.50.6', 'fe80::f816:3eff:fef2:b9d2', '192.168.10.6', 'fe80::f816:3eff:fe14:5ee4', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc2b:84ff:fee2:3a4c', 'fe80::fc16:3eff:fe8a:c06e', 'fe80::2063:58ff:fe52:4e38', 'fe80::fc16:3eff:fe8e:50e9', 'fe80::fc16:3eff:fe0e:355', 'fe80::fc16:3eff:fec1:6441', 'fe80::a481:4ff:fe8a:5924', 'fe80::c87e:11ff:fe22:1ec1', 'fe80::fc16:3eff:fe7d:9f81', 'fe80::fc16:3eff:feeb:ca96', 'fe80::fc16:3eff:fe77:4e7a', 'fe80::fc16:3eff:fe3d:1851', 'fe80::fc16:3eff:fe98:9ac9', 'fe80::1c89:f9ff:fe1d:81', 'fe80::fc16:3eff:fe34:d5bb', 'fe80::9849:a3ff:fe89:f70e', 'fe80::fc16:3eff:fe60:5adf', 'fe80::e454:63ff:fe15:5c57', 'fe80::fc16:3eff:fe29:c85', 'fe80::fc16:3eff:fedb:b452', 'fe80::c01e:b0ff:fe97:5d70', 'fe80::fc16:3eff:fefb:566a', 'fe80::fc16:3eff:fe0c:6120', 'fe80::682d:3aff:fe51:290b', 'fe80::fc16:3eff:fead:d6ac'] Jun 09 11:52:10.705185 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 09 11:52:10.705185 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.lightos [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] LIGHTOS: no hostnqn found. {{(pid=98325) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 09 11:52:10.705185 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.214', 'host': 'np0000002435', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:b079b2bc249', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'e001dbb5-8e31-4d2d-9429-583c49bd28ff', 'nvme_native_multipath': False} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:10.705185 np0000002435 nova-compute[98325]: DEBUG nova.virt.block_device [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Updating existing volume attachment record: 9d73a247-9c6f-4012-9688-d2c9b6b43375 {{(pid=98325) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 09 11:52:10.738910 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:10.748295 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:10.760931 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:10.765606 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.780319 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.787877 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.812129 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.812771 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.820171 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.820606 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:10.849909 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:10.854199 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Paused> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:10.854509 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] VM Paused (Lifecycle Event) Jun 09 11:52:10.882964 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.40.100,3260] Jun 09 11:52:10.882964 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.40.100,3260] successful. Jun 09 11:52:10.882964 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.904454 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.918290 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.50.100,3260] Jun 09 11:52:10.918290 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.50.100,3260] successful. Jun 09 11:52:10.918290 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.931230 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.931613 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:10.932057 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:10.932223 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:10.933819 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:10.935674 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] HCTL ('9', '-', '-', 0) found on session 56 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:10.935930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:10.958332 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Searching for a device in session 56 and hctl ['9', '*', '*', 0] yield: None {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.258s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:10.962827 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:10.965170 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] HCTL ('10', '-', '-', 0) found on session 57 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:10.965170 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:10.985106 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Searching for a device in session 57 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:10.985474 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c23e4e27-749e-438b-bf5d-b112c7d335a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:11.150804 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-plugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:11.151930 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:11.152194 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:11.152424 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:11.152589 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Processing event network-vif-plugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 09 11:52:11.152781 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-plugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:11.152940 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:11.153134 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:11.153237 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:11.153411 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] No waiting events found dispatching network-vif-plugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:11.153559 np0000002435 nova-compute[98325]: WARNING nova.compute.manager [req-6e1a62fc-a013-4ebe-87c4-d55f41acd701 req-c2c37224-868e-4f52-820e-9e398665dc98 service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received unexpected event network-vif-plugged-49564634-0d84-4bee-ab08-85d73e85b82d for instance with vm_state building and task_state spawning. Jun 09 11:52:11.155479 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] Releasing lock "refresh_cache-e1001828-c3fe-4a34-9f23-39d957daca78" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:11.155646 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Received event network-changed-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:11.155831 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Refreshing instance network info cache due to event network-changed-04cc83e9-6880-42a9-9615-529f3b0e85b3. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:52:11.156128 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] Acquiring lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:52:11.156219 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] Acquired lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:11.156363 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Refreshing network info cache for port 04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:52:11.158229 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98325) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 09 11:52:11.165346 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Guest created on hypervisor {{(pid=98325) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 09 11:52:11.173253 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Instance spawned successfully. Jun 09 11:52:11.177924 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 09 11:52:11.182209 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:11.283252 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Calling os-brick to attach iSCSI Volume {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 09 11:52:11.284499 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:11.285010 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:11.360133 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:11.362924 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Emitting event Resumed> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:11.363115 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] VM Resumed (Lifecycle Event) Jun 09 11:52:11.399361 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 27d39b84-6464-471d-a472-d459193cba46] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:11.567990 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7aa95e5b-ba07-4038-ac6a-633e1d9722ba req-3c6f537b-e873-4757-8e45-af36f2574dfd service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-deleted-972fd9d4-c41e-4586-a696-46db1e2103d1 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:11.569749 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-7aa95e5b-ba07-4038-ac6a-633e1d9722ba req-3c6f537b-e873-4757-8e45-af36f2574dfd service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-deleted-db5b2c30-999a-4205-a9e3-0e05c15b24f3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:11.660094 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:11.695651 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Found default for hw_cdrom_bus of ide {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:52:11.695851 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Found default for hw_disk_bus of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:52:11.696188 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Found default for hw_input_bus of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:52:11.696438 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Found default for hw_pointer_model of None {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:52:11.696773 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Found default for hw_video_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:52:11.697228 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Found default for hw_vif_model of virtio {{(pid=98325) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 09 11:52:11.866220 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:11.868901 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98325) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 09 11:52:11.902550 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 27d39b84-6464-471d-a472-d459193cba46] Took 5.03 seconds to deallocate network for instance. Jun 09 11:52:11.958575 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Searching for a device in session 56 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:11.958575 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c23e4e27-749e-438b-bf5d-b112c7d335a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:11.982412 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-5436e62b-0428-4e54-82b0-76b10754ac0f req-938e4cc6-57da-4242-9ee1-2e9e6c5d6634 service nova] [instance: 27d39b84-6464-471d-a472-d459193cba46] Received event network-vif-deleted-9ef25b9f-6e2e-4716-986b-bac1f4bf61ab {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:12.115443 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:12.205706 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Took 11.48 seconds to spawn the instance on the hypervisor. Jun 09 11:52:12.205871 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:12.304438 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updated VIF entry in instance network info cache for port 04cc83e9-6880-42a9-9615-529f3b0e85b3. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:52:12.306293 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updating instance_info_cache with network_info: [{"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:12.372328 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] During sync_power_state the instance has a pending task (spawning). Skip. Jun 09 11:52:12.721868 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Took 20.52 seconds to build instance. Jun 09 11:52:12.724729 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Found WWN 330000000a9689819 for multipath device dm-3 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:52:12.725056 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:12.725209 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000a9689819', 'path': '/dev/dm-3', 'multipath_id': '330000000a9689819'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:12.725356 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a9689819', 'path': '/dev/dm-3', 'multipath_id': '330000000a9689819'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:52:12.727031 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.442s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:12.727988 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 09 11:52:12.732538 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'flavor' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:12.744327 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:12.745256 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:12.747458 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:12.748442 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:12.749534 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:12.749844 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:12.763585 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:52:12.763585 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:12.773055 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 09 11:52:12.773055 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f] added Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:52:12.784882 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f] added Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: stderr=iscsiadm: Config file line 363 does not have value Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: iscsiadm: Config file line 363 does not have value Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 09 11:52:12.792030 np0000002435 nova-compute[98325]: {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:12.792355 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98325) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 09 11:52:12.792728 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0426(s), this was the 1st time calling it. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 09 11:52:12.792894 np0000002435 nova-compute[98325]: DEBUG os_brick.utils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98325) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 09 11:52:12.807198 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-fed27b08-5f94-4fbc-a80f-f8155203b5d6 req-08a6cf4b-7401-4d60-b03d-b546e2ae45ce service nova] Releasing lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:13.224883 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-f9773d22-9fb4-4294-b7d3-82140ddcf21d tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.036s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:13.228167 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Received event network-changed-04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:13.228806 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Refreshing instance network info cache due to event network-changed-04cc83e9-6880-42a9-9615-529f3b0e85b3. {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 09 11:52:13.229021 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] Acquiring lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 09 11:52:13.229158 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] Acquired lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 09 11:52:13.229327 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Refreshing network info cache for port 04cc83e9-6880-42a9-9615-529f3b0e85b3 {{(pid=98325) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 09 11:52:13.236490 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Attempting to attach volume c23e4e27-749e-438b-bf5d-b112c7d335a6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] attach device xml: Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: c23e4e27-749e-438b-bf5d-b112c7d335a6 Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: Jun 09 11:52:13.239097 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:52:13.651312 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Took 1.75 seconds to detach 3 volumes for instance. Jun 09 11:52:13.734528 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:13.786895 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 09 11:52:13.795742 np0000002435 nova-compute[98325]: INFO os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.40.100 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:13.810800 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.name = iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.tpgt = -1 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.startup = manual Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.leading_login = No Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.iscsi_ifacename = default Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.net_ifacename = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.ipaddress = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.prefix_len = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.hwaddress = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.transport_name = tcp Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.initiatorname = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.vlan_id = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.vlan_priority = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.vlan_state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.iface_num = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.mtu = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.port = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.bootproto = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.subnet_mask = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.gateway = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id_state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_alt_client_id = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_dns = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_learn_iqn = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_req_vendor_id_state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id_state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_vendor_id = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.dhcp_slp_da = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.fragmentation = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.gratuitous_arp = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.incoming_forwarding = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tos_state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tos = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.ttl = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.delayed_ack = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tcp_nagle = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tcp_wsf_state = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tcp_wsf = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tcp_timer_scale = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.tcp_timestamp = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.redirect = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.def_task_mgmt_timeout = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.header_digest = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.data_digest = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.immediate_data = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.initial_r2t = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.data_seq_inorder = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.data_pdu_inorder = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.erl = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.max_receive_data_len = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.first_burst_len = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.max_outstanding_r2t = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.max_burst_len = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.chap_auth = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.bidi_chap = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.strict_login_compliance = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.discovery_auth = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: iface.discovery_logout = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.discovery_address = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.discovery_port = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.discovery_type = fw Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.initial_cmdsn = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.initial_login_retry_max = 8 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.xmit_thread_priority = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.cmds_max = 128 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.queue_depth = 32 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.nr_sessions = 1 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.auth.authmethod = None Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.auth.username = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.auth.password = *** Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.auth.username_in = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.auth.password_in = Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.auth.chap_algs = SHA256 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.timeo.replacement_timeout = 120 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.err_timeo.abort_timeout = 15 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.err_timeo.lu_reset_timeout = 30 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.err_timeo.host_reset_timeout = 60 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.FastAbort = Yes Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.InitialR2T = No Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.ImmediateData = Yes Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.FirstBurstLength = 262144 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.MaxBurstLength = 16776192 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Retain = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.DefaultTime2Wait = 2 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.MaxConnections = 1 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.iscsi.ERL = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.scan = auto Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.session.reopen_max = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].address = 192.168.50.100 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].port = 3260 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].startup = manual Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].tcp.window_size = 524288 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].tcp.type_of_service = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].timeo.logout_timeout = 15 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].timeo.login_timeout = 15 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].timeo.auth_timeout = 45 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_interval = 5 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].timeo.noop_out_timeout = 5 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].iscsi.HeaderDigest = None Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].iscsi.DataDigest = None Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].iscsi.IFMarker = No Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: node.conn[0].iscsi.OFMarker = No Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: # END RECORD Jun 09 11:52:13.823715 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.835749 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.836822 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.863929 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.864347 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.871154 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.871881 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:13.939446 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f, portal: 192.168.40.100,3260] Jun 09 11:52:13.939446 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f, portal: 192.168.40.100,3260] successful. Jun 09 11:52:13.939446 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.948972 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f, portal: 192.168.50.100,3260] Jun 09 11:52:13.948972 np0000002435 nova-compute[98325]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f, portal: 192.168.50.100,3260] successful. Jun 09 11:52:13.948972 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.957113 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.969502 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:13.983898 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:13.986731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:13.986731 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Connected to 192.168.40.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:13.987290 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] HCTL ('11', '-', '-', 0) found on session 58 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:13.987534 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:14.002694 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:14.003349 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.254s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:14.003897 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Connected to 192.168.50.100:3260 {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 09 11:52:14.009667 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] HCTL ('12', '-', '-', 0) found on session 59 with lun 0 {{(pid=98325) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 09 11:52:14.009667 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98325) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 09 11:52:14.009667 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Searching for a device in session 58 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:14.009873 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:14.042926 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Searching for a device in session 59 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98325) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 09 11:52:14.043166 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98325) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 09 11:52:14.163668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:14.163668 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:14.257292 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:14.485242 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updated VIF entry in instance network info cache for port 04cc83e9-6880-42a9-9615-529f3b0e85b3. {{(pid=98325) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 09 11:52:14.485581 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] [instance: 53197df6-c8eb-4a07-8ee4-50146c8cd972] Updating instance_info_cache with network_info: [{"id": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "address": "fa:16:3e:60:5a:df", "network": {"id": "62190d00-9e60-4f99-bc9d-190ddf7ae765", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-232966220-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a9614b352a405bb3aea1e60744dfd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04cc83e9-68", "ovs_interfaceid": "04cc83e9-6880-42a9-9615-529f3b0e85b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:14.748128 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 09 11:52:14.948138 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:14.949174 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:14.950343 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] No VIF found with MAC fa:16:3e:98:9a:c9, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:52:14.990682 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-b154459f-2674-4d19-b2a7-32b6e4702459 req-d2becbee-5f73-4e92-a478-56792225d792 service nova] Releasing lock "refresh_cache-53197df6-c8eb-4a07-8ee4-50146c8cd972" {{(pid=98325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 09 11:52:15.113074 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98325) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9977}} Jun 09 11:52:15.113551 np0000002435 nova-compute[98325]: DEBUG nova.compute.provider_tree [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Inventory has not changed in ProviderTree for provider: d3492327-ddbb-4ac4-8f97-93fcb625bcd0 {{(pid=98325) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 09 11:52:15.470791 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:15.616696 np0000002435 nova-compute[98325]: DEBUG nova.scheduler.client.report [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Inventory has not changed for provider d3492327-ddbb-4ac4-8f97-93fcb625bcd0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98325) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 09 11:52:15.768027 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Found WWN 3300000009617c1d9 for multipath device dm-4 {{(pid=98325) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 09 11:52:15.768756 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:15.768756 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] <== connect_volume: return (4483ms) {'type': 'block', 'scsi_wwn': '3300000009617c1d9', 'path': '/dev/dm-4', 'multipath_id': '3300000009617c1d9'} {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:15.768756 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009617c1d9', 'path': '/dev/dm-4', 'multipath_id': '3300000009617c1d9'} {{(pid=98325) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 09 11:52:15.770557 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lazy-loading 'flavor' on Instance uuid ce77fb0b-4e58-4031-83b7-9fcef9a731f1 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:16.131407 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.967s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:16.185255 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:16.215233 np0000002435 nova-compute[98325]: INFO nova.scheduler.client.report [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Deleted allocations for instance 27d39b84-6464-471d-a472-d459193cba46 Jun 09 11:52:16.274886 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] [instance: ce77fb0b-4e58-4031-83b7-9fcef9a731f1] Attempting to attach volume fa0e83ab-0d3c-4c39-8297-4c39fee57a7f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98325) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] attach device xml: Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: fa0e83ab-0d3c-4c39-8297-4c39fee57a7f Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: Jun 09 11:52:16.276981 np0000002435 nova-compute[98325]: {{(pid=98325) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 09 11:52:16.359703 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00046884199991836795 future=) submitted to {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:16.360742 np0000002435 nova-compute[98325]: DEBUG nova.virt.driver [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] Emitting event Stopped> {{(pid=98325) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 09 11:52:16.361012 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:16.361154 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] VM Stopped (Lifecycle Event) Jun 09 11:52:16.362283 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.519458841999949 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:16.362462 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=1.519247784000072 future=) was cancelled while queued, skipping {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:16.362534 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:16.541384 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-40f5e738-2905-4c66-9042-17920c847183 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.639s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:16.763828 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:16.764009 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:16.764243 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:16.764431 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:16.764687 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:16.767258 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Terminating instance Jun 09 11:52:16.864014 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-32d54754-baf5-49f0-93d5-664cbacf4df4 tempest-ServerRescueNegativeTestJSON-1703040470 tempest-ServerRescueNegativeTestJSON-1703040470-project-member] [instance: 27d39b84-6464-471d-a472-d459193cba46] Checking state {{(pid=98325) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 09 11:52:17.224776 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-65905a2c-0bb1-43bd-a784-58da3affa584 tempest-TaggedBootDevicesTest-1697688058 tempest-TaggedBootDevicesTest-1697688058-project-member] Lock "27d39b84-6464-471d-a472-d459193cba46" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 18.456s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:17.273214 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Start destroying the instance on the hypervisor. {{(pid=98325) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 09 11:52:17.302774 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:17.306511 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:17.335861 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:17.519512 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:17.526846 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:17.583750 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-31d9b538-eabb-401a-a17d-b7062773c653 req-456df355-d521-4218-8eea-1487bdd14b2e service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-unplugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:17.584006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-31d9b538-eabb-401a-a17d-b7062773c653 req-456df355-d521-4218-8eea-1487bdd14b2e service nova] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:17.584006 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-31d9b538-eabb-401a-a17d-b7062773c653 req-456df355-d521-4218-8eea-1487bdd14b2e service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:17.584867 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-31d9b538-eabb-401a-a17d-b7062773c653 req-456df355-d521-4218-8eea-1487bdd14b2e service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:17.584867 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-31d9b538-eabb-401a-a17d-b7062773c653 req-456df355-d521-4218-8eea-1487bdd14b2e service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] No waiting events found dispatching network-vif-unplugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:17.584867 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-31d9b538-eabb-401a-a17d-b7062773c653 req-456df355-d521-4218-8eea-1487bdd14b2e service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-unplugged-49564634-0d84-4bee-ab08-85d73e85b82d for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:17.635776 np0000002435 nova-compute[98325]: DEBUG nova.utils [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Queued Task(fn=>, remaining_delay=14.998500975000297 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:17.637525 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.996721296000032 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:17.637642 np0000002435 nova-compute[98325]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996596296000007 future=) {{(pid=98325) _log /opt/stack/nova/nova/utils.py:1508}} Jun 09 11:52:17.640704 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [-] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Instance destroyed successfully. Jun 09 11:52:17.642586 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lazy-loading 'resources' on Instance uuid 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60 {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:17.799422 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:17.801386 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:52:17.949614 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No BDM found with device name vda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:17.950107 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:17.950107 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No BDM found with device name hda, not building metadata. {{(pid=98325) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13233}} Jun 09 11:52:17.950107 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] No VIF found with MAC fa:16:3e:34:d5:bb, not building metadata {{(pid=98325) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13209}} Jun 09 11:52:18.144471 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1682598696',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-attachvolumemultiattachtest-server-1682598696',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-09T11:52:12Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9e3020791dcd4ef4b7980dd196a8ca96',ramdisk_id='',reservation_id='r-0lp89spn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-938991733',owner_user_name='tempest-AttachVolumeMultiAttachTest-938991733-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:52:12Z,user_data=None,user_id='8d422c8cd17d4fe5b548032f10c7c80f',uuid=9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 09 11:52:18.145055 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converting VIF {"id": "49564634-0d84-4bee-ab08-85d73e85b82d", "address": "fa:16:3e:ad:d6:ac", "network": {"id": "64715bba-d14f-4f82-935c-deb36471d247", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-99606719-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e3020791dcd4ef4b7980dd196a8ca96", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49564634-0d", "ovs_interfaceid": "49564634-0d84-4bee-ab08-85d73e85b82d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:18.145398 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:18.145636 np0000002435 nova-compute[98325]: DEBUG os_vif [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') {{(pid=98325) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 09 11:52:18.147175 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:18.147411 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49564634-0d, bridge=br-int, if_exists=True) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:18.148722 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:18.149649 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:18.150321 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:18.151889 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:18.151889 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17dbe722-06c2-4d7c-89e0-5898f2a86242) {{(pid=98325) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 09 11:52:18.152714 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:18.153777 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 09 11:52:18.153777 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:18.156087 np0000002435 nova-compute[98325]: INFO os_vif [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d6:ac,bridge_name='br-int',has_traffic_filtering=True,id=49564634-0d84-4bee-ab08-85d73e85b82d,network=Network(64715bba-d14f-4f82-935c-deb36471d247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49564634-0d') Jun 09 11:52:18.207131 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:52:18.207415 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:18.207515 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:18.207839 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:18.208099 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6722d98e-c3b5-40cd-8530-1e77e1d65498', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:52:18.208200 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:52:18.230195 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:18.230378 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:18.243841 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:18.244354 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:18.244931 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', '59')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:52:18.244931 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '55')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:18.247108 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498', '54')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:18.249087 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Resulting device map defaultdict(. at 0x77d8e0618400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'): ({'sdr'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:52:18.249327 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Removing multipathed devices sds, sdr {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:52:18.249594 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Flush multipath device 3300000004b136900 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:52:18.312159 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:18.352093 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:18.398939 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking to see if SCSI volumes sds, sdr have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:52:18.399814 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] SCSI volumes sds, sdr have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:52:18.402753 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Checking to see if device paths {'sds', 'sdr'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:52:18.416998 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Device paths {'sds', 'sdr'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:52:18.417202 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:52:18.429930 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:18.477259 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.40.100,3260] Jun 09 11:52:18.477259 np0000002435 nova-compute[98325]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.40.100,3260] successful. Jun 09 11:52:18.477259 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:18.510338 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:18.522380 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:18.566713 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.50.100,3260] Jun 09 11:52:18.566713 np0000002435 nova-compute[98325]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-6722d98e-c3b5-40cd-8530-1e77e1d65498, portal: 192.168.50.100,3260] successful. Jun 09 11:52:18.566713 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:18.593138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:18.593138 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:18.594038 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] <== disconnect_volume: return (386ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:18.594038 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:52:18.594236 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Deleting instance files /opt/stack/data/nova/instances/9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60_del Jun 09 11:52:18.594779 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Deletion of /opt/stack/data/nova/instances/9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60_del complete Jun 09 11:52:18.732596 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Detaching volume c23e4e27-749e-438b-bf5d-b112c7d335a6 Jun 09 11:52:18.789521 np0000002435 nova-compute[98325]: INFO nova.virt.block_device [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Attempting to driver detach volume c23e4e27-749e-438b-bf5d-b112c7d335a6 from mountpoint /dev/vdb Jun 09 11:52:18.796412 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Found disk vdb by alias ua-c23e4e27-749e-438b-bf5d-b112c7d335a6 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:52:18.798638 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Found disk vdb by alias ua-c23e4e27-749e-438b-bf5d-b112c7d335a6 {{(pid=98325) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 09 11:52:18.798883 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Attempting to detach device vdb from instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] detach device xml: Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: c23e4e27-749e-438b-bf5d-b112c7d335a6 Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]:
Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: Jun 09 11:52:18.799117 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:52:18.812724 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Successfully detached device vdb from instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c from the persistent domain config. Jun 09 11:52:18.812975 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] (1/8): Attempting to detach device vdb with device alias ua-c23e4e27-749e-438b-bf5d-b112c7d335a6 from instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c from the live domain config. {{(pid=98325) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] detach device xml: Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: c23e4e27-749e-438b-bf5d-b112c7d335a6 Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]:
Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: Jun 09 11:52:18.813686 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:52:19.100808 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Took 1.83 seconds to destroy the instance on the hypervisor. Jun 09 11:52:19.101647 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._common.loopingcall [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98325) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 09 11:52:19.101865 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [-] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Deallocating network for instance {{(pid=98325) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 09 11:52:19.101997 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] deallocate_for_instance() {{(pid=98325) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 09 11:52:19.102205 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:19.184843 np0000002435 nova-compute[98325]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 09 11:52:19.472437 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:19.489859 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-46d9a90d-3298-4486-bdb4-6145ae4baeff None None] Received event ua-c23e4e27-749e-438b-bf5d-b112c7d335a6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98325) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 09 11:52:19.491174 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c23e4e27-749e-438b-bf5d-b112c7d335a6 for instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 09 11:52:19.495908 np0000002435 nova-compute[98325]: INFO nova.virt.libvirt.driver [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Successfully detached device vdb from instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c from the live domain config. Jun 09 11:52:19.498639 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] calling os-brick to detach iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 09 11:52:19.498639 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c23e4e27-749e-438b-bf5d-b112c7d335a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 09 11:52:19.498639 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 09 11:52:19.499147 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 09 11:52:19.499607 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c23e4e27-749e-438b-bf5d-b112c7d335a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 09 11:52:19.499883 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', 0)] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 09 11:52:19.532296 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-518b772d-200f-46ab-be3f-cf2fd8d7ce41 tempest-VolumesSnapshotTestJSON-635713327 tempest-VolumesSnapshotTestJSON-635713327-project-member] Lock "ce77fb0b-4e58-4031-83b7-9fcef9a731f1" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.023s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6 (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f (non-flash) Jun 09 11:52:19.550396 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 09 11:52:19.554582 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37c0260c-c5d0-4c30-b9b0-e1ad7d5b56a9', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06633652-be8a-45d3-84fe-df1fbdd24d7b', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82564c96-c72d-4983-bad7-6995eb4c7ce9', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2750a3aa-fc22-4517-880b-1707f8289e41', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f5112c5-cab8-4523-9994-d3b84e13b102', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', '58'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa0e83ab-0d3c-4c39-8297-4c39fee57a7f', '59')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 09 11:52:19.554582 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', '56')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:19.555894 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6', '57')] {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 09 11:52:19.558446 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Resulting device map defaultdict(. at 0x77d8e06b1d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'): ({'sde'}, set())}) {{(pid=98325) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 09 11:52:19.560383 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Removing multipathed devices sdd, sde {{(pid=98325) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 09 11:52:19.560383 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Flush multipath device 330000000a9689819 {{(pid=98325) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 09 11:52:19.593043 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8581fbee-1749-4c76-882e-f9a3e2324625 req-0dee768b-2fca-4b57-863e-8eaa968409db service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-deleted-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:19.594479 np0000002435 nova-compute[98325]: INFO nova.compute.manager [req-8581fbee-1749-4c76-882e-f9a3e2324625 req-0dee768b-2fca-4b57-863e-8eaa968409db service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Neutron deleted interface 49564634-0d84-4bee-ab08-85d73e85b82d; detaching it from the instance and deleting it from the info cache Jun 09 11:52:19.595119 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:19.597770 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8581fbee-1749-4c76-882e-f9a3e2324625 req-0dee768b-2fca-4b57-863e-8eaa968409db service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Detach interface failed, port_id=49564634-0d84-4bee-ab08-85d73e85b82d, reason: Instance 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60 could not be found. {{(pid=98325) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 09 11:52:19.642181 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98325) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 09 11:52:19.684357 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8dc54912-158c-4acb-9a69-4d9c2180d02a req-fb58fd5e-08d5-490f-b58f-f02360867f4f service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-unplugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 09 11:52:19.684485 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-8dc54912-158c-4acb-9a69-4d9c2180d02a req-fb58fd5e-08d5-490f-b58f-f02360867f4f service nova] Acquiring lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:19.684779 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-8dc54912-158c-4acb-9a69-4d9c2180d02a req-fb58fd5e-08d5-490f-b58f-f02360867f4f service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:19.685333 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [req-8dc54912-158c-4acb-9a69-4d9c2180d02a req-fb58fd5e-08d5-490f-b58f-f02360867f4f service nova] Lock "9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:19.685588 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8dc54912-158c-4acb-9a69-4d9c2180d02a req-fb58fd5e-08d5-490f-b58f-f02360867f4f service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] No waiting events found dispatching network-vif-unplugged-49564634-0d84-4bee-ab08-85d73e85b82d {{(pid=98325) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 09 11:52:19.685743 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [req-8dc54912-158c-4acb-9a69-4d9c2180d02a req-fb58fd5e-08d5-490f-b58f-f02360867f4f service nova] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Received event network-vif-unplugged-49564634-0d84-4bee-ab08-85d73e85b82d for instance with task_state deleting. {{(pid=98325) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 09 11:52:19.687114 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 09 11:52:19.687227 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98325) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 09 11:52:19.691203 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 09 11:52:19.708358 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.linuxscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98325) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 09 11:52:19.708597 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6')] {{(pid=98325) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 09 11:52:19.725576 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:19.768006 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.40.100,3260] Jun 09 11:52:19.768006 np0000002435 nova-compute[98325]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.40.100,3260] successful. Jun 09 11:52:19.768006 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:19.791408 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:19.795949 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:19.796236 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:52:19.798681 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:19.802008 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:19.802183 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:19.802283 np0000002435 nova-compute[98325]: DEBUG nova.compute.manager [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98325) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 09 11:52:19.802523 np0000002435 nova-compute[98325]: DEBUG oslo.service.backend._threading.loopingcall [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98325) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 09 11:52:19.810040 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:19.849802 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.50.100,3260] Jun 09 11:52:19.849802 np0000002435 nova-compute[98325]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-c23e4e27-749e-438b-bf5d-b112c7d335a6, portal: 192.168.50.100,3260] successful. Jun 09 11:52:19.849802 np0000002435 nova-compute[98325]: stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:19.874141 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98325) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 09 11:52:19.874404 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.base [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 09 11:52:19.874572 np0000002435 nova-compute[98325]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] <== disconnect_volume: return (375ms) None {{(pid=98325) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 09 11:52:19.877346 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] [instance: 9971a9c4-4000-45ee-90b3-88855b1e9c9c] Disconnected iSCSI Volume {{(pid=98325) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 09 11:52:20.016969 np0000002435 nova-compute[98325]: DEBUG nova.network.neutron [-] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Updating instance_info_cache with network_info: [] {{(pid=98325) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 09 11:52:20.446293 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'flavor' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:20.473962 np0000002435 nova-compute[98325]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98325) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 09 11:52:20.522641 np0000002435 nova-compute[98325]: INFO nova.compute.manager [-] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Took 1.42 seconds to deallocate network for instance. Jun 09 11:52:20.797856 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:20.798167 np0000002435 nova-compute[98325]: DEBUG oslo_service.periodic_task [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 09 11:52:21.109049 np0000002435 nova-compute[98325]: INFO nova.compute.manager [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] [instance: 9b7bdb0f-ff3e-42cf-9dc5-7caefdbbce60] Took 0.59 seconds to detach 1 volumes for instance. Jun 09 11:52:21.302960 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:21.303127 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:21.303359 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:21.303548 np0000002435 nova-compute[98325]: DEBUG nova.compute.resource_tracker [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Auditing locally available compute resources for np0000002435 (node: np0000002435) {{(pid=98325) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 09 11:52:21.484870 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Acquiring lock "interface-9971a9c4-4000-45ee-90b3-88855b1e9c9c-16900a18-8e91-4ab1-bf5c-d487aac54f6b" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:21.485589 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "interface-9971a9c4-4000-45ee-90b3-88855b1e9c9c-16900a18-8e91-4ab1-bf5c-d487aac54f6b" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:21.617093 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 09 11:52:21.617351 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-73fea727-c6ae-4e79-a9bb-421a75707272 tempest-AttachVolumeMultiAttachTest-938991733 tempest-AttachVolumeMultiAttachTest-938991733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 09 11:52:21.957385 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff74-ec3b-4c55-8e09-75a40596c210 tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lock "9971a9c4-4000-45ee-90b3-88855b1e9c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.727s {{(pid=98325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 09 11:52:21.989020 np0000002435 nova-compute[98325]: DEBUG nova.objects.instance [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Lazy-loading 'flavor' on Instance uuid 9971a9c4-4000-45ee-90b3-88855b1e9c9c {{(pid=98325) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 09 11:52:22.353012 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98325) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12354}} Jun 09 11:52:22.356955 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:52:22.467722 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 09 11:52:22.467967 np0000002435 nova-compute[98325]: DEBUG oslo_concurrency.processutils [None req-1498374e-0814-4168-897a-d28a25fb2332 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77fb0b-4e58-4031-83b7-9fcef9a731f1/disk --force-share --output=json {{(pid=98325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 09 11:52:22.503598 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.vif [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-09T11:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-742532993',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002435',hostname='tempest-device-tagging-server-742532993',id=29,image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA35vEM+6OqXDR0JQG4cDBPDgdOrApIAreJCofMDPlXPp8kKchDPHqKG43+TSrj8dFvcp5aC9yvxAm4zT2dr4Bw2BlsISQwapJ7RuYZFUaN8iJ7TcZLuewNCfpyXuWqeA==',key_name='tempest-keypair-1101382972',keypairs=,launch_index=0,launched_at=2026-06-09T11:51:17Z,launched_on='np0000002435',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002435',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ba3c8b095803407d840bba1d5011fe4d',ramdisk_id='',reservation_id='r-0xaphmq4',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b8dcd603-8bb0-4f2a-bfa2-115620ecccb4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1193400979',owner_user_name='tempest-TaggedAttachmentsTest-1193400979-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-09T11:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8a42aa4ff1541129a17ab41caff8de1',uuid=9971a9c4-4000-45ee-90b3-88855b1e9c9c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98325) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 09 11:52:22.504448 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converting VIF {"id": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "address": "fa:16:3e:db:b4:52", "network": {"id": "4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-418855480", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba3c8b095803407d840bba1d5011fe4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16900a18-8e", "ovs_interfaceid": "16900a18-8e91-4ab1-bf5c-d487aac54f6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 09 11:52:22.505044 np0000002435 nova-compute[98325]: DEBUG nova.network.os_vif_util [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:b4:52,bridge_name='br-int',has_traffic_filtering=True,id=16900a18-8e91-4ab1-bf5c-d487aac54f6b,network=Network(4cc957ef-bc0d-49a6-8038-bd98e1ef6a8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16900a18-8e') {{(pid=98325) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 09 11:52:22.519594 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] looking for interface given config: {{(pid=98325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 09 11:52:22.521135 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] looking for interface given config: {{(pid=98325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 09 11:52:22.522743 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.driver [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] Attempting to detach device tap16900a18-8e from instance 9971a9c4-4000-45ee-90b3-88855b1e9c9c from the persistent domain config. {{(pid=98325) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] detach device xml: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: Jun 09 11:52:22.524656 np0000002435 nova-compute[98325]: {{(pid=98325) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 09 11:52:22.533665 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] looking for interface given config: {{(pid=98325) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: DEBUG nova.virt.libvirt.guest [None req-5ff84daa-b889-4e4a-b9a6-5bdf02057aed tempest-TaggedAttachmentsTest-1193400979 tempest-TaggedAttachmentsTest-1193400979-project-member] interface for config: not found in domain: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: instance-0000001d Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 9971a9c4-4000-45ee-90b3-88855b1e9c9c Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: tempest-device-tagging-server-742532993 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 2026-06-09 11:52:04 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 192 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: True Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: bare Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: qcow2 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 0 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: ide Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: pc Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: virtio Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: tempest-TaggedAttachmentsTest-1193400979-project-member Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: tempest-TaggedAttachmentsTest-1193400979 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 196608 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 196608 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 1 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: /machine Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: OpenStack Foundation Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: OpenStack Nova Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 33.1.0 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 9971a9c4-4000-45ee-90b3-88855b1e9c9c Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 9971a9c4-4000-45ee-90b3-88855b1e9c9c Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Virtual Machine Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: hvm Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: 131072 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Nehalem Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: destroy Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: restart Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: destroy Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: /usr/bin/qemu-system-x86_64 Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]:
Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]:
Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]:
Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]:
Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]:
Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: Jun 09 11:52:22.537751 np0000002435 nova-compute[98325]: